00000001:02000400:3.0F:1788927126.463438:0:3098:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788927145.514816:0:3319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788927147.797921:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 539 MB/s 00000001:01000000:2.0F:1788927148.049289:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 593 MB/s 00000001:01000000:2.0:1788927148.298705:0:3382:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2891 MB/s 00000020:02000000:0.0F:1788927149.424719:0:3411:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_56_gc16f486 00000400:02000000:1.0:1788927150.810242:0:3427:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.154@tcp [8/256/0/180] 00008000:02000000:0.0:1788927154.719713:0:3576:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788927210.927928:0:5181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788927228.652852:0:5931:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788927228.652859:0:5931:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788927228.652861:0:5931:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788927228.653016:0:5931:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000adf73576 00000080:02000400:3.0:1788927228.653026:0:5931:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788927228.663709:0:5931:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788927228.663723:0:5931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788927228.663783:0:5931:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000003d6e966) 00000020:00000080:3.0:1788927228.663815:0:5931:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788927228.771560:0:5931:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788927228.771795:0:5931:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788927228.788410:0:5931:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788927228.788702:0:5931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788927228.788710:0:5931:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788927228.788722:0:5931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e91e0 00000020:01000004:2.0:1788927228.788728:0:5931:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788927228.788733:0:5931:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788927228.788737:0:5931:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000adf73576 from MGS 00000020:01000004:2.0:1788927228.788741:0:5931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788927228.788760:0:5931:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000079bb1ec) 00000020:00000080:2.0:1788927228.788771:0:5931:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788927228.788895:0:5931:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000adf73576 from MGS, refs=2 00080000:01000000:2.0:1788927228.788902:0:5931:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788927228.788907:0:5931:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e91ee 00000100:00100000:2.0:1788927228.789197:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788927228.789342:0:5931:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788927228.789348:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788927228.789901:0:5931:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788927228.789909:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788927228.790981:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788927228.791242:0:5931:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788927228.791248:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788927228.791881:0:5931:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788927228.791888:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788927228.792252:0:5931:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788927228.792259:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788927228.792933:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927228.792936:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927228.792939:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927228.793279:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927228.793281:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927228.793283:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927228.793808:0:5931:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788927228.798094:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788927229.042787:0:5931:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 5338 MB/s 00000001:01000000:0.0:1788927229.292865:0:5931:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4803 MB/s 00000001:01000000:3.0:1788927229.543075:0:5931:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 431 MB/s 00000001:01000000:0.0:1788927229.798278:0:5931:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 396 MB/s 00080000:10000000:0.0:1788927229.813864:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1788927229.851110:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788927229.852737:0:5931:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788927229.856082:0:5945:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788927229.856233:0:5931:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788927229.856284:0:5931:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788927229.856543:0:5931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788927229.856567:0:5931:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788927229.858711:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788927229.859137:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788927229.859145:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788927229.864141:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788927229.864160:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788927229.864623:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788927229.864630:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788927229.869114:0:5931:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788927229.869149:0:5931:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.154@tcp' 00000020:01000004:0.0:1788927229.869151:0:5931:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788927229.869195:0:5931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.154@tcp (typ=mgc) 00000020:00000080:0.0:1788927229.869217:0:5931:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.154@tcp (000000005a4d7403) 00000020:00000080:0.0:1788927229.869233:0:5931:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788927229.869376:0:5931:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000556b653@MGC192.168.203.154@tcp: add connection 192.168.203.154@tcp at head 00010000:00010000:0.0:1788927229.869523:0:5931:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.154@tcp-0 is initialized 00000040:01000000:0.0:1788927229.869528:0:5931:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.154@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788927229.870173:0:5950:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788927229.877906:0:5951:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788927229.878324:0:5931:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.154@tcp (uuid a3b70cda-d4d0-488a-a813-7f141061abda) 00000020:00000080:0.0:1788927229.878346:0:5931:0:(genops.c:1385:class_connect()) connect: client a3b70cda-d4d0-488a-a813-7f141061abda, cookie 0x750239bd504e91fc 00000100:00080000:0.0:1788927229.878358:0:5931:0:(import.c:510:import_select_connection()) MGC192.168.203.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788927229.878363:0:5931:0:(import.c:624:import_select_connection()) MGC192.168.203.154@tcp: import 000000000556b653 using connection 192.168.203.154@tcp/0@lo 00000100:00100000:0.0:1788927229.878405:0:5931:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8838f81 x1875826075238528/t0(0) o250->MGC192.168.203.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788927229.878535:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8838f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3b70cda-d4d0-488a-a813-7f141061abda:3442:1875826075238528:0@lo:250: 00000100:00100000:0.0:1788927229.878619:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788927229.878672:0:5931:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a3b70cda-d4d0-488a-a813-7f141061abda->MGS 00000020:01000004:0.0:1788927229.878691:0:5931:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788927229.878710:0:5931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788927229.878722:0:5931:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c3417142) 00000020:00000080:0.0:1788927229.878734:0:5931:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788927229.886255:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075238528 00000100:00100000:3.0:1788927229.886269:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075238528 00000100:00100000:3.0:1788927229.886609:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788927229.886618:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050764d63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3442:x1875826075238528:12345-0@lo:250: 00010000:00080000:3.0:1788927229.886645:0:5947:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a3b70cda-d4d0-488a-a813-7f141061abda@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1788927229.886752:0:5947:0:(genops.c:1385:class_connect()) connect: client a3b70cda-d4d0-488a-a813-7f141061abda, cookie 0x750239bd504e920a 00000100:00080000:3.0:1788927229.886890:0:5947:0:(import.c:65:import_set_state_nolock()) 00000000df3a02fe : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788927229.886995:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050764d63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+5:3442:x1875826075238528:12345-0@lo:250: Request processed in 376us (8375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927229.887343:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788927229.887415:0:3442:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788927229.887424:0:3442:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.154@tcp: connect to target with instance 0 00000100:00080000:3.0:1788927229.887431:0:3442:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788927229.887435:0:3442:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788927229.887437:0:3442:0:(import.c:65:import_set_state_nolock()) 000000000556b653 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788927229.887440:0:3442:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788927229.887448:0:3442:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788927229.887452:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8838f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3b70cda-d4d0-488a-a813-7f141061abda:3442:1875826075238528:0@lo:250: 00000100:00100000:3.0:1788927229.913562:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788927229.914222:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788927229.914231:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788927229.923583:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788927229.923626:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788927229.926272:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788927229.926284:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788927229.927323:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788927229.927856:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788927229.927864:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788927229.937423:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788927229.937441:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788927230.023810:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788927230.024352:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788927230.024360:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788927230.029907:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788927230.029921:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788927230.030966:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788927230.031346:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788927230.031351:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788927230.039371:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788927230.039392:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788927230.048315:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788927230.048511:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788927230.048518:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788927230.050885:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788927230.050899:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788927230.052680:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788927230.052851:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788927230.052858:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788927230.056469:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788927230.056499:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788927230.103984:0:5931:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788927230.104440:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788927230.104446:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788927230.105867:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788927230.105876:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788927230.106780:0:5931:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788927230.106788:0:5931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788927230.108379:0:5931:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788927230.108408:0:5931:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788927230.108414:0:5931:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788927230.108528:0:5931:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788927230.108562:0:5931:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.154@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788927230.108567:0:5931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788927230.108568:0:5931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788927230.108570:0:5931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927230.108571:0:5931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927230.108572:0:5931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927230.108573:0:5931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927230.108575:0:5931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788927230.108576:0:5931:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788927230.108577:0:5931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927230.108578:0:5931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927230.108580:0:5931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927230.108581:0:5931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788927230.108583:0:5931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788927230.108585:0:5931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788927230.108586:0:5931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788927230.108587:0:5931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927230.108589:0:5931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927230.108590:0:5931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927230.108591:0:5931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927230.108592:0:5931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788927230.108592:0:5931:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788927230.108617:0:5931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927230.108618:0:5931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927230.108619:0:5931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927230.108620:0:5931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788927230.108856:0:5931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788927230.108884:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5db64e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075238656:0@lo:253: 00000100:00100000:2.0:1788927230.108949:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927230.109148:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075238656 00000100:00100000:0.0:1788927230.109156:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075238656 00000100:00100000:0.0:1788927230.109197:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927230.109205:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ce82d56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+5:5931:x1875826075238656:12345-0@lo:253: 20000000:01000000:0.0:1788927230.109247:0:5949:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788927230.109250:0:5949:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1788927230.109382:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ffaee01 going to sleep for 11 seconds 10000000:01000000:0.0:1788927230.111178:0:5970:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788927230.111313:0:5949:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788927230.111589:0:5949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788927230.116061:0:5971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788927230.116826:0:5949:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788927230.116832:0:5949:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788927230.116838:0:5949:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788927230.116841:0:5949:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788927230.116854:0:5949:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788927230.117405:0:5949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927230.117569:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788927230.117584:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788927230.119347:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788927230.119384:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788927230.119401:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788927230.119481:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788927230.119492:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788927230.119505:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788927230.119510:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788927230.119520:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788927230.119525:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788927230.119561:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788927230.119577:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788927230.119638:0:5949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788927230.119644:0:5949:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788927230.119652:0:5949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927230.120980:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788927230.121073:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788927230.121096:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788927230.121111:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788927230.121138:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788927230.121151:0:5949:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788927230.121190:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788927230.121197:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788927230.121209:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788927230.121222:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788927230.121235:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788927230.121243:0:5949:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788927230.121265:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788927230.121274:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788927230.121286:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788927230.121300:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788927230.121365:0:5949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788927230.121382:0:5949:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788927230.121388:0:5949:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788927230.123861:0:5972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788927230.124428:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788927230.124454:0:5949:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.154@tcp for mdt 20000000:01000000:1.0:1788927230.124457:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.154@tcp (null) (null) (null) 00000040:00080000:1.0:1788927230.124484:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788927230.124493:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788927230.124522:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788927230.124528:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.154@tcp (null) (null) 00000040:00080000:1.0:1788927230.124542:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788927230.124549:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788927230.124561:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788927230.124573:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788927230.124643:0:5949:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788927230.124646:0:5949:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788927230.124650:0:5949:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788927230.124714:0:5949:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788927230.124716:0:5949:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788927230.125550:0:5973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788927230.126026:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788927230.126053:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788927230.126067:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788927230.126077:0:5949:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788927230.126079:0:5949:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788927230.130854:0:5974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788927230.131204:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788927230.131230:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788927230.131244:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788927230.131272:0:5949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788927230.131275:0:5949:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788927230.131280:0:5949:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788927230.131283:0:5949:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788927230.131289:0:5949:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788927230.131295:0:5949:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788927230.136483:0:5975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788927230.136705:0:5949:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788927230.158042:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788927230.158077:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788927230.158091:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788927230.158111:0:5949:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788927230.158154:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158170:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158179:0:5949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158184:0:5949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158190:0:5949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158197:0:5949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158202:0:5949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000befbb37f already unused, calling callback (00000000818f1d5c) 00010000:00010000:2.0:1788927230.158205:0:5949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158213:0:5949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158223:0:5949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158230:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.158235:0:5949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000befbb37f/0x750239bd504e9211 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788927230.158264:0:5949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788927230.174222:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ce82d56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+5:5931:x1875826075238656:12345-0@lo:253: Request processed in 65011us (65266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.174244:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788927230.174338:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5db64e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075238656:0@lo:253: 10000000:01000000:3.0:1788927230.174353:0:5931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788927230.174357:0:5931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788927230.174358:0:5931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788927230.174360:0:5931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927230.174361:0:5931:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788927230.174362:0:5931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927230.174363:0:5931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927230.174364:0:5931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788927230.174366:0:5931:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788927230.174367:0:5931:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788927230.174368:0:5931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927230.174369:0:5931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788927230.174387:0:5931:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000adf73576 from lustre-MDT0000 10000000:01000000:3.0:1788927230.174437:0:5931:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788927230.174439:0:5931:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788927230.174443:0:5931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9189491499b8 10000000:01000000:3.0:1788927230.174447:0:5931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788927230.174455:0:5931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9189491499b8 from 1 10000000:01000000:3.0:1788927230.174458:0:5931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788927230.174580:0:5931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.174592:0:5931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.174746:0:5931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927230.174771:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007ee1a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075238784:0@lo:101: 00000100:00100000:3.0:1788927230.174811:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927230.174928:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c07839cf going to sleep for 11 seconds 00000100:00100000:1.0:1788927230.175237:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075238784 00000100:00100000:1.0:1788927230.175244:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075238784 00000100:00100000:1.0:1788927230.175345:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927230.175354:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ede917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+5:5931:x1875826075238784:12345-0@lo:101: 00010000:00010000:1.0:1788927230.175367:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927230.175380:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057305e60/0x750239bd504e921f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9218 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.175401:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057305e60/0x750239bd504e921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9218 expref: 6 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.175410:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057305e60/0x750239bd504e921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9218 expref: 6 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.175419:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057305e60, rc 0) 00000100:00100000:1.0:1788927230.175489:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ede917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+6:5931:x1875826075238784:12345-0@lo:101: Request processed in 137us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927230.175497:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788927230.175565:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007ee1a8a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075238784:0@lo:101: 00010000:00010000:2.0:1788927230.175577:0:5931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.175586:0:5931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.175679:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f9d8e5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075238912:0@lo:501: 00000100:00100000:2.0:1788927230.175709:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.176133:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4d00eb2 going to sleep for 11 seconds 00000100:00100000:3.0:1788927230.176292:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075238912 00000100:00100000:3.0:1788927230.176298:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075238912 00000100:00100000:3.0:1788927230.176335:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788927230.176343:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ce8d02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+6:5931:x1875826075238912:12345-0@lo:501: 00000100:00100000:3.0:1788927230.176428:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ce8d02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+6:5931:x1875826075238912:12345-0@lo:501: Request processed in 85us (717us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788927230.176435:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788927230.176559:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f9d8e5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075238912:0@lo:501: 10000000:01000000:2.0:1788927230.176588:0:5931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788927230.176627:0:5931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.176636:0:5931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 00000000ff861eee/0x750239bd504e9218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927230.176646:0:5931:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91895033f000 10000000:01000000:2.0:1788927230.176650:0:5931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788927230.176654:0:5931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91895033f000 10000000:01000000:2.0:1788927230.176657:0:5931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788927230.176775:0:5931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91895033f000 from 1 10000000:01000000:2.0:1788927230.176787:0:5931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788927230.176811:0:5931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.176818:0:5931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.176825:0:5931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.176838:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f9d8e5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239040:0@lo:101: 00000100:00100000:2.0:1788927230.176983:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.182534:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4d00eb2 going to sleep for 11 seconds 00000100:00100000:1.0:1788927230.184334:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239040 00000100:00100000:1.0:1788927230.184347:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239040 00000100:00100000:2.0:1788927230.187173:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788927230.187193:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b46cb10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+6:5931:x1875826075239040:12345-0@lo:101: 00010000:00010000:2.0:1788927230.187213:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927230.187233:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f91603b/0x750239bd504e922d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9226 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.187259:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f91603b/0x750239bd504e922d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9226 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.187268:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f91603b/0x750239bd504e922d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9226 expref: 7 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.187276:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f91603b, rc 0) 00000100:00100000:2.0:1788927230.187367:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b46cb10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+7:5931:x1875826075239040:12345-0@lo:101: Request processed in 182us (10498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.187374:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788927230.187586:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f9d8e5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239040:0@lo:101: 00010000:00010000:0.0:1788927230.187625:0:5931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e922d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.187647:0:5931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e922d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927230.187814:0:5931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788927230.187832:0:5931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e922d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.187839:0:5931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 00000000befbb37f/0x750239bd504e9226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e922d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927230.187846:0:5931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788927230.187852:0:5931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788927230.187857:0:5931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91895033f000 10000000:01000000:0.0:1788927230.187860:0:5931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788927230.187863:0:5931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788927230.187865:0:5931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788927230.187903:0:5931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.187909:0:5931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.187916:0:5931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927230.187932:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd0300bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239168:0@lo:101: 00000100:00100000:0.0:1788927230.187970:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927230.190925:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd712cf going to sleep for 11 seconds 00000100:00100000:3.0:1788927230.191216:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239168 00000100:00100000:3.0:1788927230.191226:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239168 00000100:00100000:3.0:1788927230.191285:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788927230.191293:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef461010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+7:5931:x1875826075239168:12345-0@lo:101: 00010000:00010000:3.0:1788927230.191317:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927230.191338:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b6c8eaf/0x750239bd504e923b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9234 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.191364:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b6c8eaf/0x750239bd504e923b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9234 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.191374:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b6c8eaf/0x750239bd504e923b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9234 expref: 8 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.191383:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b6c8eaf, rc 0) 00000100:00100000:3.0:1788927230.191670:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef461010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+8:5931:x1875826075239168:12345-0@lo:101: Request processed in 368us (3690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927230.191688:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788927230.192108:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd0300bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239168:0@lo:101: 00010000:00010000:0.0:1788927230.196090:0:5931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.196111:0:5931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927230.196263:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd0300bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239296:0@lo:501: 00000100:00100000:0.0:1788927230.196338:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927230.196463:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd712cf going to sleep for 11 seconds 00000100:00100000:1.0:1788927230.196731:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239296 00000100:00100000:1.0:1788927230.196752:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239296 00000100:00100000:0.0:1788927230.197111:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788927230.197188:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b652492a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+8:5931:x1875826075239296:12345-0@lo:501: 00000100:00100000:0.0:1788927230.197369:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b652492a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5931:x1875826075239296:12345-0@lo:501: Request processed in 250us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927230.197377:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788927230.197455:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd0300bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239296:0@lo:501: 00000100:00100000:2.0:1788927230.197574:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bacd6921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239424:0@lo:503: 00000100:00100000:2.0:1788927230.197638:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.197711:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074dc7c4d going to sleep for 11 seconds 00000100:00100000:0.0:1788927230.197818:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239424 00000100:00100000:0.0:1788927230.197824:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239424 00000100:00100000:0.0:1788927230.197859:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788927230.197865:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000836151e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5931:x1875826075239424:12345-0@lo:503: 00000100:00100000:0.0:1788927230.198247:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000836151e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5931:x1875826075239424:12345-0@lo:503: Request processed in 381us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927230.198255:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788927230.198365:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bacd6921 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239424:0@lo:503: 00000100:00100000:1.0:1788927230.198865:0:5976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5976:1875826075239552:0@lo:502: 00000100:00100000:1.0:1788927230.199449:0:5976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927230.199499:0:5976:0:(client.c:2715:ptlrpc_set_wait()) set 000000004810b8b6 going to sleep for 11 seconds 00000100:00100000:0.0:1788927230.199629:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239552 00000100:00100000:0.0:1788927230.199635:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239552 00000100:00100000:0.0:1788927230.199739:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788927230.199747:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064290ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5976:x1875826075239552:12345-0@lo:502: 00000100:00100000:0.0:1788927230.199856:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064290ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5976:x1875826075239552:12345-0@lo:502: Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927230.199982:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788927230.200316:0:5976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5976:1875826075239552:0@lo:502: 00000020:01000000:1.0:1788927230.200344:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927230.200356:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927230.200358:0:5976:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788927230.200362:0:5976:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788927230.200365:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788927230.200388:0:5976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000875447b4) 00000020:00000080:1.0:1788927230.200407:0:5976:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788927230.200414:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788927230.200514:0:5976:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788927230.200522:0:5976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e9249 00000020:00000080:1.0:1788927230.201087:0:5976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788927230.201093:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927230.201097:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927230.201098:0:5976:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788927230.201101:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927230.201105:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927230.201106:0:5976:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788927230.201109:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788927230.201116:0:5976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000019bf3b7c) 00000020:00000080:1.0:1788927230.201197:0:5976:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788927230.201201:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788927230.201203:0:5976:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788927230.201206:0:5976:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788927230.201211:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788927230.201268:0:5976:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000adf73576 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788927230.201288:0:5976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a71708ed) 00000020:00000080:1.0:1788927230.201296:0:5976:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788927230.201372:0:5976:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788927230.201379:0:5976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x750239bd504e925e 00000020:00000080:1.0:1788927230.201469:0:5976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788927230.201542:0:5976:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788927230.201548:0:5976:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x750239bd504e9265 00080000:01000000:1.0:1788927230.201553:0:5976:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788927230.201556:0:5976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e926c 00080000:10000000:1.0:1788927230.203098:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788927230.203370:0:5976:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788927230.217347:0:5976:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788927230.487805:0:5976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788927230.488121:0:5976:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788927230.493558:0:5976:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788927230.495117:0:5976:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788927230.501081:0:5976:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000074c4ebb) 00000020:00000080:0.0:1788927230.501105:0:5976:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788927230.501214:0:5976:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788927230.501222:0:5976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e927a 00000020:00000080:0.0:1788927230.518328:0:5976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788927230.519498:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788927230.535837:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788927230.546838:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.551920:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.561428:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788927230.569585:0:5976:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788927230.578778:0:5976:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x750239bd504e9281 00000020:00000080:0.0:1788927230.581844:0:5976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788927230.581857:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927230.581864:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927230.581866:0:5976:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788927230.581869:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927230.581873:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927230.581875:0:5976:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788927230.581878:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788927230.581879:0:5976:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788927230.581882:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927230.581884:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927230.581885:0:5976:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788927230.581887:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927230.581891:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927230.581892:0:5976:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788927230.581897:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788927230.581945:0:5976:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788927230.582019:0:5976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aade84a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5976:1875826075239680:0@lo:502: 00000100:00100000:0.0:1788927230.582112:0:5976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927230.582167:0:5976:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ad3d39b going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.582403:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239680 00000100:00100000:2.0:1788927230.582410:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239680 00000100:00100000:2.0:1788927230.582452:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788927230.582460:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca488ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5976:x1875826075239680:12345-0@lo:502: 00000100:00100000:2.0:1788927230.582620:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca488ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+9:5976:x1875826075239680:12345-0@lo:502: Request processed in 135us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.582628:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788927230.582811:0:5976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aade84a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5976:1875826075239680:0@lo:502: 00000020:01000000:0.0:1788927230.582837:0:5976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927230.582842:0:5976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927230.582843:0:5976:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788927230.582846:0:5976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788927230.583114:0:5931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788927230.583135:0:5931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788927230.583155:0:5931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.583164:0:5931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 00000000da1df225/0x750239bd504e9234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927230.583171:0:5931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91895033f000 from 1 10000000:01000000:2.0:1788927230.583174:0:5931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788927230.583198:0:5931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.583205:0:5931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.583226:0:5931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.583240:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bfae6e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239808:0@lo:101: 00000100:00100000:2.0:1788927230.583277:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.583321:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066a90fc4 going to sleep for 11 seconds 00000100:00100000:0.0:1788927230.583411:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239808 00000100:00100000:0.0:1788927230.583416:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239808 00000100:00100000:0.0:1788927230.583451:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788927230.583457:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000208da8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+9:5931:x1875826075239808:12345-0@lo:101: 00010000:00010000:0.0:1788927230.583467:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927230.583493:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9288 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.583512:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9288 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.583521:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9288 expref: 10 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.583530:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4cd7001, rc 0) 00000100:00100000:0.0:1788927230.583572:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000208da8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+10:5931:x1875826075239808:12345-0@lo:101: Request processed in 115us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927230.583579:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788927230.583673:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bfae6e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239808:0@lo:101: 00010000:00010000:3.0:1788927230.583686:0:5931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.583694:0:5931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927230.584310:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239936:0@lo:256: 00000100:00100000:3.0:1788927230.584357:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927230.584384:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086e52dca going to sleep for 11 seconds 00000100:00100000:0.0:1788927230.584751:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075239936 00000100:00100000:0.0:1788927230.584757:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075239936 00000100:00100000:0.0:1788927230.584791:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788927230.584797:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d3712e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+10:5931:x1875826075239936:12345-0@lo:256: 20000000:01000000:0.0:1788927230.584821:0:5947:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788927230.584826:0:5947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788927230.584896:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d3712e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+10:5931:x1875826075239936:12345-0@lo:256: Request processed in 99us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927230.584903:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788927230.585793:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075239936:0@lo:256: 10000000:01000000:3.0:1788927230.587320:0:5931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788927230.587344:0:5931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.587358:0:5931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927230.587368:0:5931:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91895033f000 from 1 10000000:01000000:3.0:1788927230.587370:0:5931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788927230.587413:0:5931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.587421:0:5931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.587439:0:5931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927230.587460:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240064:0@lo:101: 00000100:00100000:3.0:1788927230.588875:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927230.588983:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086e52dca going to sleep for 11 seconds 00000100:00100000:0.0:1788927230.590402:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240064 00000100:00100000:0.0:1788927230.590414:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240064 00000100:00100000:0.0:1788927230.590512:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788927230.590521:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f75b3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+10:5931:x1875826075240064:12345-0@lo:101: 00010000:00010000:0.0:1788927230.590539:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927230.590559:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9296 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.590586:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9296 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.590736:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9296 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927230.590747:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1ad2866, rc 0) 00000100:00100000:1.0:1788927230.590871:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f75b3aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:5931:x1875826075240064:12345-0@lo:101: Request processed in 350us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927230.590879:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788927230.590999:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240064:0@lo:101: 00010000:00010000:3.0:1788927230.591016:0:5931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.591024:0:5931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927230.591095:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240192:0@lo:501: 00000100:00100000:3.0:1788927230.591132:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927230.591699:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086e52dca going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.591910:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240192 00000100:00100000:2.0:1788927230.591917:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240192 00000100:00100000:2.0:1788927230.592099:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788927230.592108:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efe0149a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:5931:x1875826075240192:12345-0@lo:501: 00000100:00100000:2.0:1788927230.592275:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efe0149a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:5931:x1875826075240192:12345-0@lo:501: Request processed in 169us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.592282:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788927230.592393:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240192:0@lo:501: 00000100:00100000:3.0:1788927230.592432:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240320:0@lo:503: 00000100:00100000:3.0:1788927230.592494:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927230.592521:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086e52dca going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.592649:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240320 00000100:00100000:2.0:1788927230.592654:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240320 00000100:00100000:2.0:1788927230.592673:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788927230.592679:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000471f4873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:5931:x1875826075240320:12345-0@lo:503: 00000040:00080000:2.0:1788927230.592711:0:5948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788927230.592749:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000471f4873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:5931:x1875826075240320:12345-0@lo:503: Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.592755:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788927230.593165:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097809deb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240320:0@lo:503: 00000040:00080000:3.0:1788927230.594875:0:5980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788927230.595153:0:5931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788927230.595174:0:5931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788927230.595198:0:5931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595211:0:5931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927230.595270:0:5931:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788927230.595273:0:5931:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91895033f000 10000000:01000000:2.0:1788927230.595276:0:5931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91895033f000 10000000:01000000:2.0:1788927230.595290:0:5931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788927230.595295:0:5931:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91895033f000 from 1 10000000:01000000:2.0:1788927230.595298:0:5931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788927230.595344:0:5931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595351:0:5931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595361:0:5931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.595380:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240448:0@lo:101: 00000100:00100000:2.0:1788927230.595440:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.595488:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 00000000075ec6ef going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.595510:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240448 00000100:00100000:2.0:1788927230.595515:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240448 00000100:00100000:2.0:1788927230.595554:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788927230.595562:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f7fa539 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:5931:x1875826075240448:12345-0@lo:101: 00010000:00010000:2.0:1788927230.595575:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927230.595588:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6eb951a/0x750239bd504e92ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e92a4 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595644:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6eb951a/0x750239bd504e92ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e92a4 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595665:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6eb951a/0x750239bd504e92ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e92a4 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595673:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6eb951a, rc 0) 00000100:00100000:2.0:1788927230.595711:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f7fa539 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075240448:12345-0@lo:101: Request processed in 149us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.595717:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788927230.595762:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240448:0@lo:101: 00010000:00010000:2.0:1788927230.595775:0:5931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.595782:0:5931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.595825:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240576:0@lo:501: 00000100:00100000:2.0:1788927230.595847:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.595861:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 00000000075ec6ef going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.595873:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240576 00000100:00100000:2.0:1788927230.595877:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240576 00000100:00100000:2.0:1788927230.595897:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788927230.595902:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d7b3423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075240576:12345-0@lo:501: 00000100:00100000:2.0:1788927230.596531:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d7b3423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075240576:12345-0@lo:501: Request processed in 627us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.596539:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788927230.596574:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240576:0@lo:501: 00000100:00100000:2.0:1788927230.596623:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240704:0@lo:503: 00000100:00100000:2.0:1788927230.596668:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.596682:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096388486 going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.596697:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240704 00000100:00100000:2.0:1788927230.596701:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240704 00000100:00100000:2.0:1788927230.596725:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788927230.596730:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e913326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075240704:12345-0@lo:503: 00000100:00100000:2.0:1788927230.596810:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e913326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075240704:12345-0@lo:503: Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.596816:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788927230.596860:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075240704:0@lo:503: 00000100:00100000:2.0:1788927230.597312:0:5981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5981:1875826075240832:0@lo:502: 00000100:00100000:2.0:1788927230.597348:0:5981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.597368:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240832 00000100:00100000:2.0:1788927230.597372:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240832 00000100:00100000:2.0:1788927230.597393:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927230.597399:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b121de7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:5981:x1875826075240832:12345-0@lo:502: 00000100:00100000:2.0:1788927230.597464:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b121de7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:5981:x1875826075240832:12345-0@lo:502: Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.597535:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927230.597565:0:5981:0:(client.c:2715:ptlrpc_set_wait()) set 00000000075ec6ef going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.597576:0:5981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5981:1875826075240832:0@lo:502: 00000020:01000004:2.0:1788927230.597644:0:5981:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788927230.597659:0:5981:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000375e7549) 00000020:00000080:2.0:1788927230.597676:0:5981:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788927230.597761:0:5981:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000adf73576 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788927230.597766:0:5981:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000adf73576 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788927230.597774:0:5981:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000adf73576 4 00010000:00080000:2.0:1788927230.597802:0:5981:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b46b20ce@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.154@tcp at head 00010000:00010000:2.0:1788927230.605254:0:5981:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788927230.605540:0:5981:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788927230.605583:0:5981:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788927230.605745:0:5981:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x750239bd504e92b9 00000100:00080000:2.0:1788927230.605755:0:5981:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788927230.605760:0:5981:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b46b20ce using connection 192.168.203.154@tcp/0@lo 00000100:00100000:2.0:1788927230.605793:0:5981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c53fe26e x1875826075240960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788927230.605845:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1875826075240960:0@lo:38: 00000100:00100000:3.0:1788927230.605912:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788927230.606097:0:5981:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788927230.606278:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075240960 00000100:00100000:0.0:1788927230.606286:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075240960 00000100:00100000:0.0:1788927230.606336:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788927230.606343:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097809deb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3442:x1875826075240960:12345-0@lo:38: 00000100:00100000:2.0:1788927230.606755:0:5981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5475c6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5981:1875826075241088:0@lo:502: 00000100:00100000:2.0:1788927230.606803:0:5981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.606826:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241088 00000100:00100000:2.0:1788927230.606829:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241088 00000100:00100000:2.0:1788927230.606858:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788927230.606865:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ff6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5981:x1875826075241088:12345-0@lo:502: 00000100:00100000:2.0:1788927230.606978:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ff6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5981:x1875826075241088:12345-0@lo:502: Request processed in 114us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.606986:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788927230.607268:0:5981:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092c37d73 going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.607289:0:5981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5475c6d pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:5981:1875826075241088:0@lo:502: 00000040:00080000:2.0:1788927230.607324:0:5981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788927230.607374:0:5931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788927230.607392:0:5931:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788927230.607414:0:5931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.607435:0:5931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 0000000066d7fafd/0x750239bd504e92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788927230.607549:0:5931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788927230.607551:0:5931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788927230.607553:0:5931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927230.607554:0:5931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927230.607555:0:5931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927230.607556:0:5931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927230.607558:0:5931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788927230.607559:0:5931:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788927230.607561:0:5931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927230.607562:0:5931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927230.607564:0:5931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927230.607565:0:5931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788927230.607568:0:5931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788927230.607571:0:5931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788927230.607572:0:5931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788927230.607574:0:5931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927230.607575:0:5931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927230.607576:0:5931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927230.607577:0:5931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927230.607578:0:5931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788927230.607579:0:5931:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788927230.607580:0:5931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927230.607581:0:5931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927230.607582:0:5931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927230.607583:0:5931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788927230.607614:0:5931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788927230.607737:0:5931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5475c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075241216:0@lo:253: 00000100:00100000:2.0:1788927230.607778:0:5931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.607794:0:5931:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2169263 going to sleep for 11 seconds 00000100:00100000:2.0:1788927230.607810:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241216 00000100:00100000:2.0:1788927230.607814:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241216 00000100:00100000:2.0:1788927230.607841:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788927230.607855:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001862c873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075241216:12345-0@lo:253: 20000000:01000000:2.0:1788927230.607876:0:5947:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788927230.607887:0:5947:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788927230.612239:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097809deb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3442:x1875826075240960:12345-0@lo:38: Request processed in 5885us (6317us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788927230.612255:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788927230.629282:0:3442:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788927230.629327:0:3442:0:(import.c:65:import_set_state_nolock()) 00000000b46b20ce lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788927230.629335:0:3442:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788927230.629339:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c53fe26e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1875826075240960:0@lo:38: 20000000:01000000:3.0:1788927230.631333:0:5947:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788927230.631357:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788927230.631614:0:5970:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788927230.631619:0:5970:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788927230.631640:0:5970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.631659:0:5970:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.631667:0:5970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.631707:0:5970:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.631721:0:5970:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.631735:0:5970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b1cfd9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5970:1875826075241344:0@lo:104: 00000100:00100000:2.0:1788927230.631797:0:5970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.631842:0:5970:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092c37d73 going to sleep for 11 seconds 00000100:00100000:3.0:1788927230.631933:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241344 00000100:00100000:3.0:1788927230.631949:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241344 00000100:00100000:3.0:1788927230.631997:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788927230.632004:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090c020dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:5970:x1875826075241344:12345-0@lo:104: 00010000:00010000:3.0:1788927230.632016:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927230.632068:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788927230.632073:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090c020dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:5970:x1875826075241344:12345-0@lo:104: Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927230.632080:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788927230.632219:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788927230.632224:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.632232:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005406ff50 already unused, calling callback (000000003e86bc5f) 10000000:00010000:2.0:1788927230.632235:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.632258:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927230.632264:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927230.632269:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927230.632295:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.632312:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927230.632328:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.632335:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: 000000005406ff50/0x750239bd504e9288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e928f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927230.632352:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927230.632354:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927230.632355:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927230.632412:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927230.632420:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a24481d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075241472:0@lo:103: 00000100:00100000:2.0:1788927230.632447:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927230.632492:0:5970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b1cfd9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5970:1875826075241344:0@lo:104: 00010000:00010000:2.0:1788927230.632510:0:5970:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927230.632556:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001862c873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:5931:x1875826075241216:12345-0@lo:253: Request processed in 24702us (24778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927230.632572:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788927230.632630:0:5931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5475c6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:5931:1875826075241216:0@lo:253: 10000000:01000000:2.0:1788927230.632639:0:5931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788927230.632643:0:5931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788927230.632644:0:5931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788927230.632646:0:5931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927230.632647:0:5931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927230.632648:0:5931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927230.632649:0:5931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927230.632651:0:5931:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788927230.632652:0:5931:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788927230.632654:0:5931:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927230.632655:0:5931:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927230.632656:0:5931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927230.632658:0:5931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788927230.632667:0:5931:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788927230.634717:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241472 00000100:00100000:1.0:1788927230.634729:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241472 00010000:00010000:1.0:1788927230.634758:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927230.634792:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927230.634800:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c14a149f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+12:3443:x1875826075241472:12345-0@lo:103: 00010000:00010000:1.0:1788927230.634811:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788927230.634815:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634826:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634841:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4cd7001/0x750239bd504e928f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9288 expref: 12 pid: 5949 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634874:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634882:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788927230.634897:0:5939:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003279463s 00010000:00010000:1.0:1788927230.634901:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634907:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634913:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634919:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634925:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2b2ed05 already unused, calling callback (00000000818f1d5c) 00010000:00010000:1.0:1788927230.634928:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634946:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634962:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.634971:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788927230.635113:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c14a149f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+11:3443:x1875826075241472:12345-0@lo:103: Request processed in 314us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927230.635121:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927230.635167:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a24481d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075241472:0@lo:103: 00010000:00010000:1.0:1788927230.635192:0:5970:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.635200:0:5970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927230.635205:0:5970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788927230.651047:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.651201:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788927230.651406:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.651552:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788927230.651773:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.651927:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788927230.663382:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.663568:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788927230.663794:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.663974:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788927230.664196:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788927230.664377:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788927230.674806:0:5931:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788927230.696336:0:5931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788927230.696730:0:5986:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788927230.696741:0:5986:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788927230.696856:0:5987:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788927230.709342:0:5931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788927230.709461:0:5931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927230.713842:0:5987:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788927230.714888:0:5931:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788927230.716830:0:5931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788927230.717096:0:5931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788927230.718124:0:5931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788927230.718701:0:5931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788927230.718734:0:5931:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788927230.718907:0:5931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788927230.719140:0:5931:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788927230.719849:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788927230.719960:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788927230.720075:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788927230.720192:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788927230.728483:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788927230.728755:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788927230.729025:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788927230.729172:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000040:00080000:0.0:1788927230.729775:0:5987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788927230.729852:0:5987:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788927230.729856:0:5987:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788927230.731010:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788927230.731445:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788927230.731635:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788927230.731763:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788927230.731901:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788927230.732041:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788927230.732417:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788927230.732545:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788927230.732952:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788927230.733109:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788927230.733403:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788927230.733541:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788927230.733711:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788927230.733969:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788927230.734119:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788927230.734443:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788927230.734619:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788927230.734772:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788927230.734930:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788927230.735064:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788927230.735485:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788927230.735686:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788927230.735843:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788927230.736047:0:5931:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788927230.736371:0:5931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788927230.749925:0:5931:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788927230.749964:0:5931:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6f84198f988 00100000:10000000:3.0:1788927230.749973:0:5931:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788927230.755764:0:5931:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788927230.755782:0:5931:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788927230.755801:0:5931:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788927230.755818:0:5931:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788927230.757506:0:5931:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788927230.757721:0:5931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788927230.876913:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927231.898852:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927232.936699:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927233.947015:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927234.971707:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788927235.680484:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788927235.680492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788927235.680495:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b46b20ce lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788927235.680507:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b46b20ce using connection 192.168.203.154@tcp/0@lo 00000100:00100000:2.0:1788927235.680527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000061b1cfd9 x1875826075241728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788927235.680566:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b1cfd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1875826075241728:0@lo:38: 00000100:00100000:2.0:1788927235.680662:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927235.680904:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5475c6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075241600:0@lo:400: 00000100:00100000:1.0:1788927235.680940:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927235.683462:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241600 00000100:00100000:2.0:1788927235.683475:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241600 00000100:00100000:2.0:1788927235.683546:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788927235.683555:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096ad0259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:3445:x1875826075241600:12345-0@lo:400: 00000100:00100000:2.0:1788927235.683666:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096ad0259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:3445:x1875826075241600:12345-0@lo:400: Request processed in 113us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927235.683673:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788927235.683732:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5475c6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075241600:0@lo:400: 00000100:00100000:0.0:1788927235.684053:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241728 00000100:00100000:0.0:1788927235.684058:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241728 00000100:00100000:0.0:1788927235.684090:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927235.684095:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049ed2313 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3442:x1875826075241728:12345-0@lo:38: 00010000:00080000:0.0:1788927235.684117:0:5956:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788927235.684153:0:5956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x750239bd504e92c7 00000004:00100000:0.0:1788927235.684198:0:5956:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788927235.684323:0:5956:0:(import.c:65:import_set_state_nolock()) 000000003fce73fc : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788927235.684386:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049ed2313 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3442:x1875826075241728:12345-0@lo:38: Request processed in 289us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927235.684393:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788927235.687962:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000061b1cfd9 x1875826075241728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788927245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788927235.687986:0:3442:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788927235.687995:0:3442:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788927235.688000:0:3442:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788927235.688003:0:3442:0:(import.c:65:import_set_state_nolock()) 00000000b46b20ce lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788927235.688009:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b1cfd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3442:1875826075241728:0@lo:38: 00010000:00010000:0.0:1788927236.001208:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927237.019671:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788927237.730903:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788927237.730911:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91895033f000 from 3 10000000:01000000:1.0:1788927237.730916:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788927237.730960:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927237.730985:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927237.730996:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927237.731020:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075241856:0@lo:101: 00000100:00100000:1.0:1788927237.731100:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927237.731152:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e594294c going to sleep for 11 seconds 00000100:00100000:3.0:1788927237.731224:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241856 00000100:00100000:3.0:1788927237.731232:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241856 00000100:00100000:3.0:1788927237.731300:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788927237.731309:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c767044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:5951:x1875826075241856:12345-0@lo:101: 00010000:00010000:3.0:1788927237.731322:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927237.731334:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0dd2f89/0x750239bd504e92d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e92ce expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927237.731356:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0dd2f89/0x750239bd504e92d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e92ce expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927237.731366:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0dd2f89/0x750239bd504e92d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e92ce expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927237.731376:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0dd2f89, rc 0) 00000100:00100000:3.0:1788927237.731419:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c767044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075241856:12345-0@lo:101: Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927237.731427:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788927237.731727:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075241856:0@lo:101: 00010000:00010000:1.0:1788927237.731742:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927237.731750:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927237.731799:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075241984:0@lo:256: 00000100:00100000:1.0:1788927237.731832:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927237.731874:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e594294c going to sleep for 11 seconds 00000100:00100000:0.0:1788927237.731948:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075241984 00000100:00100000:0.0:1788927237.731953:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075241984 00000100:00100000:0.0:1788927237.731989:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788927237.731996:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008acca447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075241984:12345-0@lo:256: 20000000:01000000:0.0:1788927237.732010:0:5949:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788927237.732025:0:5949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788927237.732029:0:5949:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788927237.732127:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008acca447 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075241984:12345-0@lo:256: Request processed in 132us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927237.732134:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788927237.734725:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075241984:0@lo:256: 10000000:01000000:1.0:1788927237.734797:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788927237.734806:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927237.734816:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: 00000000b6770855/0x750239bd504e92ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1788927237.868216:0:6232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788927238.045798:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927239.066775:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788927239.746194:0:6284:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788927239.750310:0:6284:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788927240.108455:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927240.799475:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a40b13c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075242240:0@lo:400: 00000100:00100000:1.0:1788927240.799542:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927240.799637:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242240 00000100:00100000:1.0:1788927240.799645:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242240 00000100:00100000:1.0:1788927240.799687:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927240.799695:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007d0a4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075242240:12345-0@lo:400: 00000100:00100000:1.0:1788927240.799758:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007d0a4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075242240:12345-0@lo:400: Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927240.799764:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788927240.799876:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a40b13c5 x1875826075242240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927240.799891:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a40b13c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075242240:0@lo:400: 00000100:00100000:3.0:1788927240.800186:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075242112:0@lo:400: 00000100:00100000:3.0:1788927240.800228:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927240.803957:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242112 00000100:00100000:1.0:1788927240.803973:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242112 00000100:00100000:1.0:1788927240.804030:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788927240.804039:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000054bf958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:3446:x1875826075242112:12345-0@lo:400: 00000100:00100000:1.0:1788927240.804125:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000054bf958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:3446:x1875826075242112:12345-0@lo:400: Request processed in 88us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927240.804132:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788927240.804185:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075242112:0@lo:400: 00010000:00010000:3.0:1788927241.114759:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927242.151169:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788927243.136136:0:6387:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788927243.136818:0:6387:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788927243.163286:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927244.186796:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788927244.422301:0:6435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1ee3a4c0 20000000:00000080:3.0:1788927244.422317:0:6435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff918974561400 uarg=0000000000000000 20000000:01000000:3.0:1788927244.422356:0:6435:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788927244.422362:0:6435:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788927244.422367:0:6435:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788927244.422431:0:6435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788927244.422468:0:6435:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788927244.428085:0:6435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788927244.428333:0:6435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788927244.428363:0:6435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788927244.428541:0:6435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788927244.428560:0:6435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788927244.428577:0:6435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927244.428628:0:6435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9296 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927244.428637:0:6435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927244.428678:0:6435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9296 expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927244.428690:0:6435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9296 expref: 11 pid: 5947 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927244.428823:0:6435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070d5444e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6435:1875826075242368:0@lo:104: 00000100:00100000:3.0:1788927244.428883:0:6435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927244.429035:0:6435:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035ccbe37 going to sleep for 11 seconds 00000100:00100000:1.0:1788927244.430510:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242368 00000100:00100000:1.0:1788927244.430524:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242368 00000100:00100000:1.0:1788927244.431540:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788927244.431557:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001307591d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:6435:x1875826075242368:12345-0@lo:104: 00010000:00010000:1.0:1788927244.431592:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927244.431732:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788927244.431738:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001307591d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:6435:x1875826075242368:12345-0@lo:104: Request processed in 188us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927244.431746:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788927244.431814:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788927244.431819:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.431827:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000068763b2 already unused, calling callback (000000003e86bc5f) 10000000:00010000:0.0:1788927244.431831:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.431839:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788927244.431845:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927244.431850:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788927244.431887:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.431894:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788927244.431922:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.431929:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: 00000000068763b2/0x750239bd504e9296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e929d expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.431947:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927244.431955:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927244.431957:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927244.431981:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aade84a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075242496:0@lo:103: 00000100:00100000:0.0:1788927244.432037:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927244.432096:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242496 00000100:00100000:0.0:1788927244.432102:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242496 00010000:00010000:0.0:1788927244.432142:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9296 expref: 12 pid: 5947 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927244.432146:0:6435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070d5444e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6435:1875826075242368:0@lo:104: 00010000:00010000:2.0:1788927244.432173:0:6435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927244.432177:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927244.432189:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036079320 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+12:3444:x1875826075242496:12345-0@lo:103: 00010000:00010000:0.0:1788927244.432200:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927244.432204:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9296 expref: 12 pid: 5947 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432227:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9296 expref: 12 pid: 5947 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432241:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1ad2866/0x750239bd504e929d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9296 expref: 12 pid: 5947 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432256:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432264:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432279:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432285:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432297:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432303:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432308:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005584f56 already unused, calling callback (00000000818f1d5c) 00010000:00010000:0.0:1788927244.432311:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432318:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432337:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927244.432346:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927244.432385:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036079320 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+11:3444:x1875826075242496:12345-0@lo:103: Request processed in 199us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927244.432391:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927244.432418:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aade84a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075242496:0@lo:103: 00010000:00010000:2.0:1788927244.433188:0:6435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927244.433200:0:6435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927244.433230:0:6435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005584f56/0x750239bd504e92dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927245.211776:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927245.915205:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aade84a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075242624:0@lo:400: 00000100:00100000:2.0:1788927245.915286:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927245.915362:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788927245.915368:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029359d5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075242752:0@lo:400: 00000100:00100000:2.0:1788927245.915396:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927245.915574:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242624 00000100:00100000:3.0:1788927245.915583:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242624 00000100:00100000:3.0:1788927245.915661:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788927245.915670:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e2dce6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:3445:x1875826075242624:12345-0@lo:400: 00000100:00100000:3.0:1788927245.915730:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e2dce6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:3445:x1875826075242624:12345-0@lo:400: Request processed in 60us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927245.915737:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788927245.915801:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aade84a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075242624:0@lo:400: 00000100:00100000:0.0:1788927245.915951:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242752 00000100:00100000:0.0:1788927245.915956:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242752 00000100:00100000:0.0:1788927245.915997:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927245.916003:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5475c6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075242752:12345-0@lo:400: 00000100:00100000:0.0:1788927245.916051:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5475c6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075242752:12345-0@lo:400: Request processed in 48us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927245.916073:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788927245.917658:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000029359d5d x1875826075242752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927245.917676:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029359d5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075242752:0@lo:400: 00010000:00010000:1.0:1788927246.238301:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927247.258790:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927248.285029:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927249.306873:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927250.331021:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927251.056781:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927251.056809:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088259299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075242880:0@lo:400: 00000100:00100000:3.0:1788927251.056884:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927251.056948:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075242880 00000100:00100000:3.0:1788927251.056956:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075242880 00000100:00100000:3.0:1788927251.057004:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788927251.057012:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f9cb91b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+11:3444:x1875826075242880:12345-0@lo:400: 00000100:00100000:3.0:1788927251.057064:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f9cb91b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+11:3444:x1875826075242880:12345-0@lo:400: Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927251.057071:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788927251.057117:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088259299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075242880:0@lo:400: 00000100:00100000:3.0:1788927251.057192:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088259299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075243008:0@lo:400: 00000100:00100000:3.0:1788927251.057219:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927251.057256:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243008 00000100:00100000:3.0:1788927251.057261:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243008 00000100:00100000:3.0:1788927251.057299:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788927251.057306:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa4b301b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075243008:12345-0@lo:400: 00000100:00100000:3.0:1788927251.057341:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa4b301b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075243008:12345-0@lo:400: Request processed in 36us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927251.057348:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788927251.057376:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000088259299 x1875826075243008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927251.057388:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088259299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075243008:0@lo:400: 00010000:00010000:0.0:1788927251.365248:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788927252.058735:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788927252.058744:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91895033f000 from 1 10000000:01000000:0.0:1788927252.058750:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788927252.058798:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: 00000000c1ad2866/0x750239bd504e92e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927252.058812:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: 00000000c1ad2866/0x750239bd504e92e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927252.058833:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: 00000000c1ad2866/0x750239bd504e92e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927252.058856:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001160f41d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075243136:0@lo:101: 00000100:00100000:0.0:1788927252.058922:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927252.058984:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecdab3da going to sleep for 11 seconds 00000100:00100000:2.0:1788927252.059054:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243136 00000100:00100000:2.0:1788927252.059062:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243136 00000100:00100000:2.0:1788927252.059125:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788927252.059134:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a28d0b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:5951:x1875826075243136:12345-0@lo:101: 00010000:00010000:2.0:1788927252.059146:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927252.059168:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e92e3 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927252.059192:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e92e3 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927252.059201:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2b2ed05/0x750239bd504e92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e92e3 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927252.059211:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2b2ed05, rc 0) 00000100:00100000:2.0:1788927252.059271:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a28d0b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075243136:12345-0@lo:101: Request processed in 138us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927252.059278:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788927252.059359:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001160f41d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075243136:0@lo:101: 00010000:00010000:1.0:1788927252.059373:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: 00000000c1ad2866/0x750239bd504e92e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927252.059382:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: 00000000c1ad2866/0x750239bd504e92e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927252.059442:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075243264:0@lo:501: 00000100:00100000:1.0:1788927252.059470:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927252.059496:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552b11e7 going to sleep for 11 seconds 00000100:00100000:3.0:1788927252.059697:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243264 00000100:00100000:3.0:1788927252.059703:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243264 00000100:00100000:3.0:1788927252.059735:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788927252.059741:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb3eac70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075243264:12345-0@lo:501: 00000100:00100000:3.0:1788927252.059876:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb3eac70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075243264:12345-0@lo:501: Request processed in 134us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927252.059883:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788927252.060013:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075243264:0@lo:501: 00000100:00100000:1.0:1788927252.060042:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075243392:0@lo:503: 00000100:00100000:1.0:1788927252.060091:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927252.060117:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set 00000000552b11e7 going to sleep for 11 seconds 00000100:00100000:3.0:1788927252.061108:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243392 00000100:00100000:3.0:1788927252.061116:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243392 00000100:00100000:3.0:1788927252.061234:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788927252.061241:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e6563de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075243392:12345-0@lo:503: 00000100:00100000:3.0:1788927252.061350:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e6563de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075243392:12345-0@lo:503: Request processed in 110us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927252.061358:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788927252.061501:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075243392:0@lo:503: 00000100:00100000:1.0:1788927252.071288:0:6761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:6761:1875826075243520:0@lo:502: 00000100:00100000:1.0:1788927252.071377:0:6761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927252.071423:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243520 00000100:00100000:1.0:1788927252.071426:0:6761:0:(client.c:2715:ptlrpc_set_wait()) set 000000005aa0c197 going to sleep for 11 seconds 00000100:00100000:2.0:1788927252.071432:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243520 00000100:00100000:2.0:1788927252.071487:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788927252.071497:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bf69f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:6761:x1875826075243520:12345-0@lo:502: 00000100:00100000:2.0:1788927252.071778:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bf69f27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:6761:x1875826075243520:12345-0@lo:502: Request processed in 283us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927252.071787:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788927252.075971:0:6761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052fe840b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:6761:1875826075243520:0@lo:502: 00000020:01000000:0.0:1788927252.076038:0:6761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927252.076049:0:6761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927252.076051:0:6761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788927252.076059:0:6761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91895033f000 00000020:00000080:0.0:1788927252.076063:0:6761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788927252.076117:0:6761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:6761:1875826075243648:0@lo:502: 00000100:00100000:0.0:1788927252.076201:0:6761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927252.076248:0:6761:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788927252.079346:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243648 00000100:00100000:1.0:1788927252.079383:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243648 00000100:00100000:1.0:1788927252.080094:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788927252.080105:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:6761:x1875826075243648:12345-0@lo:502: 00000100:00100000:1.0:1788927252.080300:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:6761:x1875826075243648:12345-0@lo:502: Request processed in 196us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927252.080308:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788927252.083148:0:6761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:6761:1875826075243648:0@lo:502: 00000020:01000000:0.0:1788927252.083211:0:6761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927252.083222:0:6761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927252.083224:0:6761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788927252.083229:0:6761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788927252.085873:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788927252.085908:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788927252.085921:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927252.085934:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927252.385027:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927253.411703:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927254.427205:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788927254.987120:0:6934:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788927254.987123:0:6934:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788927254.987125:0:6934:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788927254.987259:0:6934:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff918974bed000 00000020:01000004:3.0:1788927254.987274:0:6934:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788927254.987285:0:6934:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788927254.987298:0:6934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9189494dcd28) 00000020:00000080:3.0:1788927254.987312:0:6934:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788927255.028778:0:6934:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788927255.028829:0:6934:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788927255.044187:0:6934:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788927255.045277:0:6934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788927255.045287:0:6934:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788927255.045298:0:6934:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x750239bd504e92f8 00000020:01000004:0.0:1788927255.045305:0:6934:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788927255.045429:0:6934:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788927255.045433:0:6934:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788927255.045439:0:6934:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788927255.045443:0:6934:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788927255.045454:0:6934:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91894914b370) 00000020:00000080:0.0:1788927255.045463:0:6934:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788927255.049216:0:6934:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788927255.049407:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788927255.049413:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788927255.051541:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788927255.051549:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788927255.054847:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788927255.054860:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788927255.057445:0:6934:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788927255.057663:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788927255.057670:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788927255.062482:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788927255.062495:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788927255.099025:0:6934:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788927255.099296:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788927255.099303:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788927255.104022:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788927255.104038:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788927255.105814:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788927255.105960:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788927255.108258:0:6934:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788927255.108558:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788927255.108564:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788927255.109198:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788927255.109205:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788927255.167565:0:6934:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788927255.167940:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788927255.167954:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788927255.174398:0:6934:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788927255.174418:0:6934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788927255.175378:0:6934:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788927255.175407:0:6934:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788927255.175413:0:6934:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788927255.211479:0:6934:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788927255.211522:0:6934:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.154@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788927255.211526:0:6934:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788927255.211528:0:6934:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788927255.211530:0:6934:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927255.211531:0:6934:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788927255.211533:0:6934:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927255.211534:0:6934:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927255.211536:0:6934:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788927255.211538:0:6934:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788927255.211543:0:6934:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788927255.211544:0:6934:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927255.211546:0:6934:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788927255.211549:0:6934:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788927255.211551:0:6934:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788927255.211553:0:6934:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788927255.211554:0:6934:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927255.211555:0:6934:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788927255.211556:0:6934:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927255.211557:0:6934:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927255.211558:0:6934:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788927255.211559:0:6934:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788927255.211560:0:6934:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788927255.211561:0:6934:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927255.211562:0:6934:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788927255.211587:0:6934:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788927255.211626:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075243776:0@lo:253: 00000100:00100000:3.0:1788927255.211700:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.211948:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03300 going to sleep for 11 seconds 00000100:00100000:2.0:1788927255.212038:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243776 00000100:00100000:2.0:1788927255.212052:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243776 00000100:00100000:2.0:1788927255.212100:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788927255.212111:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075243776:12345-0@lo:253: 20000000:01000000:2.0:1788927255.212147:0:5949:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788927255.212151:0:5949:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788927255.212156:0:5949:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788927255.212159:0:5949:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788927255.212385:0:5949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788927255.217814:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788927255.217949:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788927255.217982:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788927255.217989:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788927255.218001:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788927255.218016:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788927255.218254:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788927255.218272:0:5949:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.154@tcp 20000000:01000000:2.0:1788927255.218274:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788927255.218289:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788927255.218295:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788927255.218324:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788927255.218332:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.154@tcp (null) (null) 00000040:00080000:2.0:1788927255.218346:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788927255.218353:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788927255.218365:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788927255.218381:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788927255.219294:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788927255.219311:0:5949:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.154@tcp 20000000:01000000:2.0:1788927255.219313:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.154@tcp (null) (null) (null) 00000040:00080000:2.0:1788927255.219326:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788927255.219333:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788927255.219346:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788927255.219350:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.154@tcp (null) (null) 00000040:00080000:2.0:1788927255.219365:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788927255.219371:0:5949:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788927255.219382:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788927255.219397:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788927255.219409:0:5949:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788927255.219412:0:5949:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788927255.219423:0:5949:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788927255.219465:0:5949:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788927255.219467:0:5949:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788927255.220323:0:6953:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788927255.220350:0:6953:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788927255.220366:0:6953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788927255.220562:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788927255.220583:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788927255.220630:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788927255.220643:0:5949:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788927255.220644:0:5949:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788927255.221082:0:6954:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788927255.221102:0:6954:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788927255.221118:0:6954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788927255.221333:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788927255.221352:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788927255.221372:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788927255.221382:0:5949:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788927255.221383:0:5949:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788927255.221798:0:6955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788927255.222078:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788927255.222098:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788927255.222131:0:5949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788927255.222158:0:5949:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788927255.222176:0:5949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222192:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9218 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222200:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9234 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222207:0:5949:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e92a4 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222214:0:5949:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222254:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e92a4 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222267:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e92a4 expref: 12 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.222293:0:5949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5949:1875826075243904:0@lo:104: 00000100:00100000:0.0:1788927255.222353:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927255.222442:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9234 expref: 12 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.222449:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9234 expref: 12 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.222457:0:5949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967462300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5949:1875826075244032:0@lo:104: 00000100:00100000:0.0:1788927255.222479:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927255.226861:0:5949:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9218 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.226879:0:5949:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9218 expref: 12 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.226894:0:5949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5949:1875826075244160:0@lo:104: 00000100:00100000:0.0:1788927255.226950:0:5949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927255.229203:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075243904 00000100:00100000:1.0:1788927255.229219:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075243904 00000100:00100000:1.0:1788927255.229279:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244032 00000100:00100000:1.0:1788927255.229282:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244032 00000100:00100000:1.0:1788927255.229300:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927255.229309:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+4:5949:x1875826075243904:12345-0@lo:104: 00010000:00010000:1.0:1788927255.229328:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.229462:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788927255.229469:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+4:5949:x1875826075243904:12345-0@lo:104: Request processed in 161us (7116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.229475:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927255.229493:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788927255.229500:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5949:x1875826075244032:12345-0@lo:104: 00010000:00010000:1.0:1788927255.229521:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.229678:0:5949:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967484000 going to sleep for 11 seconds 00000100:00100000:0.0:1788927255.229703:0:5949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5949:1875826075243904:0@lo:104: 00000100:00100000:0.0:1788927255.229713:0:5949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967462300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5949:1875826075244032:0@lo:104: 00010000:00010000:2.0:1788927255.229764:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788927255.229772:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.229779:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189413c8a00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927255.229783:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.229791:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927255.229798:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927255.229804:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927255.229957:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.229964:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927255.229992:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.229999:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e92a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92ab expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.230012:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788927255.230014:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.230051:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918940030800 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927255.230054:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.230060:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927255.230066:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927255.230070:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927255.230087:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.230093:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927255.230098:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.230104:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918940030800/0x750239bd504e9234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e923b expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.230114:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927255.230116:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927255.230118:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927255.230172:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075244288:0@lo:103: 00000100:00100000:0.0:1788927255.230214:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.230248:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788927255.230254:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075244416:0@lo:103: 00000100:00100000:0.0:1788927255.230272:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.230309:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244288 00000100:00100000:0.0:1788927255.230313:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244288 00010000:00010000:0.0:1788927255.230332:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e92a4 expref: 13 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.230352:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244416 00000100:00100000:0.0:1788927255.230355:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244416 00010000:00010000:0.0:1788927255.230364:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9234 expref: 14 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.230376:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788927255.230382:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+14:3445:x1875826075244288:12345-0@lo:103: 00010000:00010000:0.0:1788927255.230393:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927255.230398:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e92a4 expref: 14 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.230408:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e92a4 expref: 14 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.230423:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189413c8c00/0x750239bd504e92ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e92a4 expref: 14 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.230435:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927255.230463:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+13:3445:x1875826075244288:12345-0@lo:103: Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.230470:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788927255.230482:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788927255.230488:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+12:3445:x1875826075244416:12345-0@lo:103: 00010000:00010000:0.0:1788927255.230495:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927255.230499:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9234 expref: 12 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.230515:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9234 expref: 12 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.230525:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820df400/0x750239bd504e923b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9234 expref: 12 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.230532:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927255.230554:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+11:3445:x1875826075244416:12345-0@lo:103: Request processed in 66us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.230560:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788927255.230591:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075244416:0@lo:103: 00000100:00100000:0.0:1788927255.230627:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075244288:0@lo:103: 00010000:00010000:1.0:1788927255.231159:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788927255.231170:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5949:x1875826075244032:12345-0@lo:104: Request processed in 1668us (8687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.231177:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788927255.231195:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244160 00000100:00100000:1.0:1788927255.231199:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244160 00000100:00100000:1.0:1788927255.231217:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788927255.231223:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5949:x1875826075244160:12345-0@lo:104: 00010000:00010000:1.0:1788927255.231231:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927255.231368:0:5949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5949:1875826075244160:0@lo:104: 00010000:00010000:2.0:1788927255.231388:0:5949:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231422:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788927255.231427:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231434:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820dfc00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:0.0:1788927255.231436:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231443:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788927255.231450:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927255.231455:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788927255.231517:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231532:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788927255.231559:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231565:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e9218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e921f expref: -99 pid: 5931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231577:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927255.231579:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927255.231581:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927255.231587:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788927255.231616:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075244544:0@lo:103: 00000100:00100000:0.0:1788927255.231649:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.231679:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244544 00000100:00100000:0.0:1788927255.231683:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244544 00010000:00010000:0.0:1788927255.231697:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9218 expref: 11 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.231718:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788927255.231724:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+11:3444:x1875826075244544:12345-0@lo:103: 00010000:00010000:0.0:1788927255.231732:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927255.231736:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9218 expref: 11 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231746:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9218 expref: 11 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231758:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951778200/0x750239bd504e921f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9218 expref: 11 pid: 5948 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231780:0:5940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231787:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231800:0:5940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231807:0:5940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231814:0:5940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231819:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231948:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918940031e00 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:0.0:1788927255.231952:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.231958:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.232188:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788927255.232196:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5949:x1875826075244160:12345-0@lo:104: Request processed in 972us (5245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.232203:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788927255.232252:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927255.232310:0:5949:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.232318:0:5949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788927255.232326:0:5949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788927255.234847:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.234865:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918940031e00/0x750239bd504e9306 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.234898:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927255.234971:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+10:3444:x1875826075244544:12345-0@lo:103: Request processed in 3244us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.234981:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788927255.235354:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075244544:0@lo:103: 00000100:00100000:1.0:1788927255.235513:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+9:6934:x1875826075243776:12345-0@lo:253: Request processed in 23403us (23811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.235522:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788927255.235577:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075243776:0@lo:253: 10000000:01000000:3.0:1788927255.235589:0:6934:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788927255.235592:0:6934:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788927255.235737:0:6934:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788927255.235745:0:6934:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927255.235746:0:6934:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788927255.235747:0:6934:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927255.235749:0:6934:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927255.235751:0:6934:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788927255.235752:0:6934:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788927255.235755:0:6934:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927255.235756:0:6934:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788927255.235775:0:6934:0:(tgt_mount.c:101:server_register_mount()) register mount ffff918974bed000 from lustre-OST0000 10000000:01000000:3.0:1788927255.235801:0:6934:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788927255.235803:0:6934:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788927255.235809:0:6934:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9189491499b8 local copy 10000000:01000000:3.0:1788927255.235813:0:6934:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788927255.235898:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.235907:0:6934:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.235915:0:6934:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927255.235932:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075244672:0@lo:101: 00000100:00100000:3.0:1788927255.235967:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.236234:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788927255.236270:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244672 00000100:00100000:1.0:1788927255.236277:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244672 00000100:00100000:1.0:1788927255.236353:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788927255.236363:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+9:6934:x1875826075244672:12345-0@lo:101: 00010000:00010000:1.0:1788927255.236374:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927255.236388:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951778e00/0x750239bd504e9314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e930d expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.236438:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951778e00/0x750239bd504e9314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e930d expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.236449:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951778e00/0x750239bd504e9314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e930d expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.236456:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951778e00, rc 0) 00000100:00100000:1.0:1788927255.236495:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+10:6934:x1875826075244672:12345-0@lo:101: Request processed in 135us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.236502:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788927255.236563:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075244672:0@lo:101: 00010000:00010000:3.0:1788927255.236575:0:6934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.236584:0:6934:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927255.236692:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075244800:0@lo:501: 00000100:00100000:3.0:1788927255.236733:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.237017:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788927255.237180:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244800 00000100:00100000:0.0:1788927255.237186:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244800 00000100:00100000:0.0:1788927255.237210:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788927255.237218:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+10:6934:x1875826075244800:12345-0@lo:501: 00000100:00100000:0.0:1788927255.237280:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+10:6934:x1875826075244800:12345-0@lo:501: Request processed in 63us (547us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927255.237287:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788927255.237368:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075244800:0@lo:501: 10000000:01000000:3.0:1788927255.237380:0:6934:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788927255.237397:0:6934:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788927255.237402:0:6934:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.237411:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.237419:0:6934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.237465:0:6934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788927255.237488:0:6934:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff918974bed000 10000000:01000000:3.0:1788927255.237492:0:6934:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788927255.237496:0:6934:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9189491499b8 10000000:01000000:3.0:1788927255.237499:0:6934:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788927255.237501:0:6934:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9189491499b8 from 1 10000000:01000000:3.0:1788927255.237504:0:6934:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788927255.237520:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.237528:0:6934:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.237536:0:6934:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927255.237558:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075244928:0@lo:101: 00000100:00100000:3.0:1788927255.237581:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.237664:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788927255.237739:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075244928 00000100:00100000:1.0:1788927255.237743:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075244928 00000100:00100000:1.0:1788927255.237763:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788927255.237769:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+10:6934:x1875826075244928:12345-0@lo:101: 00010000:00010000:1.0:1788927255.237776:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927255.237785:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951778000/0x750239bd504e9322 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e931b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.237799:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951778000/0x750239bd504e9322 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e931b expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.237808:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951778000/0x750239bd504e9322 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e931b expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.237815:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951778000, rc 0) 00000100:00100000:1.0:1788927255.237853:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075244928:12345-0@lo:101: Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.237858:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788927255.238010:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788927255.238016:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.238203:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820df000 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:0.0:1788927255.238207:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.238216:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788927255.238224:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927255.238230:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788927255.238253:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.238259:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788927255.238554:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075245056:0@lo:103: 00000100:00100000:1.0:1788927255.238585:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927255.238666:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.238674:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189820df000/0x750239bd504e930d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x750239bd504e9314 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.238687:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927255.238689:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927255.238691:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927255.238748:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245056 00000100:00100000:2.0:1788927255.238753:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245056 00000100:00100000:2.0:1788927255.238798:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788927255.238806:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+11:3444:x1875826075245056:12345-0@lo:103: 00010000:00010000:2.0:1788927255.238816:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927255.238837:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951778e00/0x750239bd504e9314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x750239bd504e930d expref: 11 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927255.238849:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927255.239078:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075244928:0@lo:101: 00010000:00010000:3.0:1788927255.239092:0:6934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9322 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.239101:0:6934:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9322 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927255.239117:0:6934:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788927255.239142:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9322 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.239150:0:6934:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189820dea00/0x750239bd504e931b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9322 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927255.239157:0:6934:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788927255.239161:0:6934:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788927255.239166:0:6934:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788927255.239168:0:6934:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788927255.239184:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.239190:0:6934:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.239197:0:6934:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927255.239217:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245184:0@lo:101: 00000100:00100000:3.0:1788927255.239244:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.239260:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788927255.239452:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+10:3444:x1875826075245056:12345-0@lo:103: Request processed in 646us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927255.239459:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927255.239498:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075245056:0@lo:103: 00000100:00100000:1.0:1788927255.239516:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245184 00000100:00100000:1.0:1788927255.239519:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245184 00000100:00100000:1.0:1788927255.239571:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788927255.239578:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+10:6934:x1875826075245184:12345-0@lo:101: 00010000:00010000:1.0:1788927255.239586:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927255.239624:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9329 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.239639:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9329 expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.239648:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9329 expref: 11 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.239655:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951779000, rc 0) 00000100:00100000:1.0:1788927255.239682:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245184:12345-0@lo:101: Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.239688:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788927255.240213:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245184:0@lo:101: 00010000:00010000:3.0:1788927255.240225:0:6934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.240233:0:6934:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927255.240312:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245312:0@lo:501: 00000100:00100000:3.0:1788927255.240340:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.240450:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788927255.240504:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245312 00000100:00100000:2.0:1788927255.240508:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245312 00000100:00100000:2.0:1788927255.240536:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788927255.240544:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245312:12345-0@lo:501: 00000100:00100000:2.0:1788927255.240667:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245312:12345-0@lo:501: Request processed in 123us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927255.240674:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788927255.240743:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245312:0@lo:501: 00000100:00100000:3.0:1788927255.240768:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245440:0@lo:503: 00000100:00100000:3.0:1788927255.240811:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.240840:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788927255.240933:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245440 00000100:00100000:2.0:1788927255.240938:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245440 00000100:00100000:2.0:1788927255.240958:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788927255.240965:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245440:12345-0@lo:503: 00000100:00100000:2.0:1788927255.241221:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245440:12345-0@lo:503: Request processed in 256us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927255.241228:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788927255.241295:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245440:0@lo:503: 00000040:00080000:3.0:1788927255.241507:0:6934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788927255.241570:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245568:0@lo:502: 00000100:00100000:3.0:1788927255.241648:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.241667:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788927255.241725:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245568 00000100:00100000:2.0:1788927255.241730:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245568 00000100:00100000:2.0:1788927255.241758:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788927255.241764:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245568:12345-0@lo:502: 00000100:00100000:2.0:1788927255.241911:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245568:12345-0@lo:502: Request processed in 147us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927255.241918:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788927255.241983:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245568:0@lo:502: 00000040:00080000:3.0:1788927255.242400:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788927255.242436:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788927255.242454:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788927255.242469:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788927255.242496:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788927255.242510:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788927255.242530:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245696:0@lo:502: 00000100:00100000:3.0:1788927255.242570:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.242620:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897df03c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788927255.242693:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245696 00000100:00100000:1.0:1788927255.242698:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245696 00000100:00100000:1.0:1788927255.242726:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788927255.242734:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245696:12345-0@lo:502: 00000100:00100000:1.0:1788927255.242819:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245696:12345-0@lo:502: Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927255.242985:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788927255.243116:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245696:0@lo:502: 00000040:00080000:3.0:1788927255.243165:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788927255.243173:0:6934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788927255.243788:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788927255.243794:0:6956:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788927255.243800:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927255.243802:0:6956:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788927255.243807:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788927255.243821:0:6956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9189494d8000) 00000020:00000080:3.0:1788927255.243910:0:6956:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788927255.243917:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788927255.243976:0:6956:0:(tgt_mount.c:153:server_get_mount()) get mount ffff918974bed000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788927255.243984:0:6956:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788927255.243990:0:6956:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x750239bd504e933e 00010000:00010000:3.0:1788927255.248234:0:6956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788927255.248511:0:6956:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788927255.251252:0:6956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788927255.251558:0:6956:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788927255.259052:0:6956:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788927255.259246:0:6956:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788927255.265259:0:6956:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788927255.272699:0:6956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788927255.272711:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788927255.272723:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927255.272725:0:6956:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788927255.272729:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788927255.272734:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927255.272735:0:6956:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788927255.272738:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788927255.272740:0:6956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788927255.272766:0:6956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788927255.272769:0:6956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927255.272770:0:6956:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788927255.272773:0:6956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788927255.275154:0:6934:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788927255.275198:0:6934:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788927255.275216:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275229:0:6934:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927255.275238:0:6934:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff918974bed000 from 1 10000000:01000000:0.0:1788927255.275241:0:6934:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788927255.275284:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275291:0:6934:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275302:0:6934:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.275342:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245824:0@lo:101: 00000100:00100000:0.0:1788927255.275411:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.275456:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967484600 going to sleep for 11 seconds 00000100:00100000:0.0:1788927255.275489:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245824 00000100:00100000:0.0:1788927255.275495:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245824 00000100:00100000:0.0:1788927255.275547:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788927255.275556:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+11:6934:x1875826075245824:12345-0@lo:101: 00010000:00010000:0.0:1788927255.275568:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927255.275580:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9345 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275621:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9345 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275631:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9345 expref: 12 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275640:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918940030800, rc 0) 00000100:00100000:0.0:1788927255.275678:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075245824:12345-0@lo:101: Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.275685:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788927255.275729:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245824:0@lo:101: 00010000:00010000:0.0:1788927255.275743:0:6934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.275751:0:6934:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.276851:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245952:0@lo:501: 00000100:00100000:0.0:1788927255.276894:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.276923:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967484600 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.277295:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075245952 00000100:00100000:3.0:1788927255.277302:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075245952 00000100:00100000:3.0:1788927255.277342:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788927255.277351:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075245952:12345-0@lo:501: 00000100:00100000:3.0:1788927255.277463:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075245952:12345-0@lo:501: Request processed in 112us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.277472:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788927255.277555:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075245952:0@lo:501: 00000100:00100000:0.0:1788927255.277586:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246080:0@lo:503: 00000100:00100000:0.0:1788927255.277651:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.277667:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967484600 going to sleep for 11 seconds 00000100:00100000:0.0:1788927255.277683:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246080 00000100:00100000:0.0:1788927255.277686:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246080 00000100:00100000:0.0:1788927255.277705:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788927255.277711:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246080:12345-0@lo:503: 00000100:00100000:0.0:1788927255.277797:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246080:12345-0@lo:503: Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.277804:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788927255.277961:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246080:0@lo:503: 00000040:00080000:0.0:1788927255.278206:0:6934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788927255.278273:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246208:0@lo:502: 00000100:00100000:0.0:1788927255.278311:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.278378:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967484600 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.279402:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246208 00000100:00100000:3.0:1788927255.279410:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246208 00000100:00100000:3.0:1788927255.279502:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788927255.279511:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246208:12345-0@lo:502: 00000100:00100000:3.0:1788927255.279654:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246208:12345-0@lo:502: Request processed in 144us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.279662:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788927255.279752:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246208:0@lo:502: 00000040:00080000:1.0:1788927255.279993:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788927255.280031:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788927255.280059:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246336:0@lo:502: 00000100:00100000:1.0:1788927255.280100:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927255.280431:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788927255.280477:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246336 00000100:00100000:0.0:1788927255.280482:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246336 00000100:00100000:0.0:1788927255.280507:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788927255.280513:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246336:12345-0@lo:502: 00000100:00100000:0.0:1788927255.280678:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246336:12345-0@lo:502: Request processed in 164us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.280690:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788927255.280913:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246336:0@lo:502: 00000040:00080000:1.0:1788927255.280956:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788927255.280964:0:6934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788927255.281623:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927255.281643:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927255.281646:0:6960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788927255.281652:0:6960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff918974bed000 00000020:00000080:1.0:1788927255.281655:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788927255.281667:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927255.281669:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927255.281671:0:6960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788927255.281673:0:6960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788927255.281830:0:6934:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788927255.281853:0:6934:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788927255.281874:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.281884:0:6934:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927255.281925:0:6934:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788927255.281928:0:6934:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff918974bed000 10000000:01000000:0.0:1788927255.281931:0:6934:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff918974bed000 10000000:01000000:0.0:1788927255.281934:0:6934:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788927255.281938:0:6934:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff918974bed000 from 1 10000000:01000000:0.0:1788927255.281941:0:6934:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788927255.281976:0:6934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.281984:0:6934:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.281994:0:6934:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.282010:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246464:0@lo:101: 00000100:00100000:0.0:1788927255.282057:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.282091:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967484f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.282227:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246464 00000100:00100000:3.0:1788927255.282233:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246464 00000100:00100000:3.0:1788927255.282261:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788927255.282269:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:6934:x1875826075246464:12345-0@lo:101: 00010000:00010000:3.0:1788927255.282279:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927255.282297:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9353 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.282318:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9353 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.282329:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9353 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.282338:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820dfe00, rc 0) 00000100:00100000:3.0:1788927255.282382:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246464:12345-0@lo:101: Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.282388:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788927255.282453:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246464:0@lo:101: 00010000:00010000:1.0:1788927255.282466:0:6934:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.282475:0:6934:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927255.282535:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246592:0@lo:501: 00000100:00100000:1.0:1788927255.282560:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927255.282581:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.282646:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246592 00000100:00100000:3.0:1788927255.282650:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246592 00000100:00100000:3.0:1788927255.282678:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788927255.282683:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246592:12345-0@lo:501: 00000100:00100000:3.0:1788927255.282762:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246592:12345-0@lo:501: Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.282768:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788927255.282841:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246592:0@lo:501: 00000100:00100000:1.0:1788927255.282871:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246720:0@lo:503: 00000100:00100000:1.0:1788927255.282903:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927255.282929:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.283013:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246720 00000100:00100000:3.0:1788927255.283017:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246720 00000100:00100000:3.0:1788927255.283046:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788927255.283053:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246720:12345-0@lo:503: 00000100:00100000:3.0:1788927255.283122:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246720:12345-0@lo:503: Request processed in 69us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.283129:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788927255.283216:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246720:0@lo:503: 00000040:00080000:1.0:1788927255.283423:0:6934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788927255.283475:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246848:0@lo:502: 00000100:00100000:1.0:1788927255.283508:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927255.283530:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.283572:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246848 00000100:00100000:3.0:1788927255.283576:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246848 00000100:00100000:3.0:1788927255.283626:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788927255.283632:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246848:12345-0@lo:502: 00000100:00100000:3.0:1788927255.283695:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246848:12345-0@lo:502: Request processed in 63us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.283701:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788927255.283800:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246848:0@lo:502: 00000040:00080000:1.0:1788927255.283969:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788927255.283990:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788927255.284002:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788927255.284014:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788927255.284025:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788927255.284035:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788927255.284046:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788927255.284059:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788927255.284072:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788927255.284083:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788927255.284093:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788927255.284103:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788927255.284113:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788927255.284122:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788927255.284143:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788927255.284156:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788927255.284166:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788927255.284175:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788927255.284185:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788927255.284195:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788927255.284215:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788927255.284226:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788927255.284250:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788927255.284262:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788927255.284274:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788927255.284285:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788927255.284296:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788927255.284306:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788927255.284324:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246976:0@lo:502: 00000100:00100000:1.0:1788927255.284358:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927255.284388:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.284497:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075246976 00000100:00100000:3.0:1788927255.284501:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075246976 00000100:00100000:3.0:1788927255.284531:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788927255.284538:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246976:12345-0@lo:502: 00000100:00100000:3.0:1788927255.284625:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075246976:12345-0@lo:502: Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.284632:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788927255.285147:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075246976:0@lo:502: 00000040:00080000:1.0:1788927255.285198:0:6934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788927255.285209:0:6934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788927255.285930:0:6961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788927255.285944:0:6961:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff918945950000) 00000020:00000080:1.0:1788927255.285964:0:6961:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788927255.286056:0:6961:0:(tgt_mount.c:153:server_get_mount()) get mount ffff918974bed000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788927255.286060:0:6961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff918974bed000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788927255.286063:0:6961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff918974bed000 3 00010000:00080000:1.0:1788927255.286091:0:6961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff918842fd7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.154@tcp at head 00010000:00010000:1.0:1788927255.294655:0:6961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788927255.301575:0:6961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788927255.301651:0:6961:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788927255.301666:0:6961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x750239bd504e9368 00000100:00080000:1.0:1788927255.301678:0:6961:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788927255.301685:0:6961:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff918842fd7000 using connection 192.168.203.154@tcp/0@lo 00000100:00100000:1.0:1788927255.301725:0:6961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91894593f800 x1875826075247104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788927255.301773:0:6961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788927255.303013:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788927255.303043:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075247232:0@lo:400: 00000100:00100000:1.0:1788927255.303110:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788927255.303234:0:6961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1788927255.303389:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247232 00000100:00100000:3.0:1788927255.303397:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247232 00000100:00100000:3.0:1788927255.303442:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788927255.303452:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075247232:12345-0@lo:400: 00000100:00100000:3.0:1788927255.303507:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075247232:12345-0@lo:400: Request processed in 56us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.303514:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788927255.303695:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91894592aa00 x1875826075247232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927255.303708:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075247232:0@lo:400: 00000100:00100000:2.0:1788927255.307673:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3442:1875826075247104:0@lo:38: 00000100:00100000:2.0:1788927255.307757:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788927255.307772:0:6934:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:0.0:1788927255.307930:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247104 00000100:00100000:0.0:1788927255.307939:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247104 00000100:00100000:0.0:1788927255.307995:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788927255.308004:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3442:x1875826075247104:12345-0@lo:38: 00010000:00080000:0.0:1788927255.308040:0:5955:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1788927255.308077:0:5955:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x750239bd504e936f 00000004:00100000:0.0:1788927255.308090:0:5955:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788927255.308123:0:5955:0:(import.c:65:import_set_state_nolock()) ffff918842fb5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788927255.308192:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3442:x1875826075247104:12345-0@lo:38: Request processed in 188us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.308199:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:3.0:1788927255.308519:0:6934:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788927255.308566:0:6934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.308577:0:6934:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788927255.308626:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91894593f800 x1875826075247104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788927265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927255.308636:0:3442:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788927255.308644:0:3442:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788927255.308653:0:3442:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000004:3.0:1788927255.308656:0:6934:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00080000:2.0:1788927255.308658:0:3442:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788927255.308660:0:3442:0:(import.c:65:import_set_state_nolock()) ffff918842fd7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000020:01000004:3.0:1788927255.308663:0:6934:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788927255.308665:0:6934:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927255.308667:0:6934:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:2.0:1788927255.308669:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3442:1875826075247104:0@lo:38: 00000020:01000004:3.0:1788927255.308670:0:6934:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927255.308673:0:6934:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927255.308676:0:6934:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788927255.308679:0:6934:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788927255.308680:0:6934:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788927255.308682:0:6934:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927255.308683:0:6934:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788927255.308687:0:6934:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788927255.308689:0:6934:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788927255.308691:0:6934:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788927255.308692:0:6934:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927255.308693:0:6934:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788927255.308695:0:6934:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927255.308696:0:6934:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927255.308697:0:6934:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788927255.308698:0:6934:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788927255.308699:0:6934:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788927255.308700:0:6934:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927255.308701:0:6934:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788927255.308718:0:6934:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788927255.308730:0:6934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075247360:0@lo:253: 00000100:00100000:3.0:1788927255.308766:0:6934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.308794:0:6934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9189452d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788927255.309064:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247360 00000100:00100000:0.0:1788927255.309070:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247360 00000100:00100000:0.0:1788927255.309126:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788927255.309142:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075247360:12345-0@lo:253: 20000000:01000000:0.0:1788927255.309161:0:5948:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788927255.309173:0:5948:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788927255.322181:0:5948:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788927255.322203:0:5948:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788927255.322332:0:5970:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788927255.322337:0:5970:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788927255.322361:0:5970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.322381:0:5970:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e92ce expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.322391:0:5970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.322432:0:5970:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e92ce expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927255.322446:0:5970:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e92ce expref: 13 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927255.322460:0:5970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5970:1875826075247488:0@lo:104: 00000100:00100000:1.0:1788927255.322525:0:5970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927255.322713:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:6934:x1875826075247360:12345-0@lo:253: Request processed in 13578us (13943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927255.322724:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788927255.322752:0:6934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:6934:1875826075247360:0@lo:253: 10000000:01000000:2.0:1788927255.322766:0:6934:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788927255.322770:0:6934:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788927255.322772:0:6934:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788927255.322773:0:6934:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927255.322775:0:6934:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927255.322776:0:6934:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927255.322778:0:6934:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927255.322779:0:6934:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788927255.322781:0:6934:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927255.322782:0:6934:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927255.322784:0:6934:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927255.322785:0:6934:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788927255.322801:0:6934:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788927255.322832:0:5970:0:(client.c:2715:ptlrpc_set_wait()) set ffff918942a31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788927255.329773:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247488 00000100:00100000:3.0:1788927255.329788:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247488 00000100:00100000:3.0:1788927255.329844:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788927255.329853:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:5970:x1875826075247488:12345-0@lo:104: 00010000:00010000:3.0:1788927255.329871:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.329972:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788927255.329978:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:5970:x1875826075247488:12345-0@lo:104: Request processed in 127us (7453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.330001:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788927255.330028:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788927255.330035:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330043:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927255.330048:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330056:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927255.330063:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927255.330069:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788927255.330104:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330111:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927255.330129:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330145:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e92ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92d5 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330162:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927255.330164:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927255.330166:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927255.330173:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788927255.330193:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075247616:0@lo:103: 00000100:00100000:3.0:1788927255.330232:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927255.330274:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247616 00000100:00100000:3.0:1788927255.330278:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247616 00010000:00010000:3.0:1788927255.330295:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e92ce expref: 13 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927255.330315:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788927255.330331:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949719450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+13:3445:x1875826075247616:12345-0@lo:103: 00010000:00010000:3.0:1788927255.330341:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927255.330347:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e92ce expref: 13 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330358:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e92ce expref: 13 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330376:0:5940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330385:0:5940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788927255.330399:0:5940:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008062681s 00010000:00010000:3.0:1788927255.330403:0:5940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330411:0:5940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330418:0:5940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330434:0:5940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330440:0:5940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779400 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:3.0:1788927255.330444:0:5940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330452:0:5940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330461:0:5940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927255.330470:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927255.330497:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949719450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+13:3445:x1875826075247616:12345-0@lo:103: Request processed in 176us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927255.330504:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788927255.330560:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075247616:0@lo:103: 00010000:00010000:0.0:1788927255.330651:0:5970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820dfa00/0x750239bd504e92d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e92ce expref: 12 pid: 5947 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927255.330662:0:5970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5970:1875826075247488:0@lo:104: 00010000:00010000:0.0:1788927255.330676:0:5970:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.330685:0:5970:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.330697:0:5970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927255.330704:0:5970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951779400/0x750239bd504e9376 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788927255.334358:0:6934:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788927255.334504:0:6934:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788927255.334698:0:6934:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788927255.334831:0:6934:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788927255.335007:0:6934:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788927255.335226:0:6934:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788927255.339712:0:6934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788927255.349424:0:6934:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788927255.349433:0:6934:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788927255.349467:0:6934:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788927255.349504:0:6934:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788927255.349523:0:6934:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788927255.349544:0:6934:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788927255.350305:0:6934:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788927255.350466:0:6934:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788927255.450924:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788927256.304095:0:7015:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788927256.304307:0:7015:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788927256.481636:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927257.501222:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927258.523412:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927259.546826:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927260.582529:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927260.778265:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075248000:0@lo:400: 00000100:00100000:2.0:1788927260.778338:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927260.778421:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248000 00000100:00100000:2.0:1788927260.778428:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248000 00000100:00100000:2.0:1788927260.778479:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788927260.778488:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075248000:12345-0@lo:400: 00000100:00100000:2.0:1788927260.778540:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075248000:12345-0@lo:400: Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927260.778547:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788927260.778586:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9189605c2a00 x1875826075248000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927260.778619:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075248000:0@lo:400: 00000100:00100000:1.0:1788927260.778694:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075247872:0@lo:400: 00000100:00100000:1.0:1788927260.778723:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927260.778751:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788927260.778757:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075247744:0@lo:400: 00000100:00100000:1.0:1788927260.778783:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788927260.778957:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927260.780065:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247744 00000100:00100000:1.0:1788927260.780073:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247744 00000100:00100000:1.0:1788927260.780127:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788927260.780137:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:3444:x1875826075247744:12345-0@lo:400: 00000100:00100000:1.0:1788927260.780193:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:3444:x1875826075247744:12345-0@lo:400: Request processed in 59us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927260.780200:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788927260.780242:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075247744:0@lo:400: 00000100:00100000:2.0:1788927260.780390:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075247872 00000100:00100000:2.0:1788927260.780401:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075247872 00000100:00100000:2.0:1788927260.780438:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788927260.780445:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075247872:12345-0@lo:400: 00000100:00100000:2.0:1788927260.780488:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075247872:12345-0@lo:400: Request processed in 44us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927260.780494:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788927260.780519:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9189605c1880 x1875826075247872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927260.780529:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075247872:0@lo:400: 00010000:00010000:0.0:1788927261.596644:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927262.222105:0:7305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788927262.298698:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788927262.298706:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91895033f000 from 21 10000000:01000000:1.0:1788927262.298712:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788927262.298757:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927262.298770:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927262.298781:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927262.298806:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248128:0@lo:101: 00000100:00100000:1.0:1788927262.298884:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927262.298975:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91894371a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927262.299014:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248128 00000100:00100000:0.0:1788927262.299022:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248128 00000100:00100000:0.0:1788927262.299077:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788927262.299096:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075248128:12345-0@lo:101: 00010000:00010000:0.0:1788927262.299108:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927262.299121:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e937d expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.299144:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e937d expref: 13 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.299156:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e937d expref: 13 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.299165:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1a00, rc 0) 00000100:00100000:0.0:1788927262.299257:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075248128:12345-0@lo:101: Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927262.299265:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788927262.304462:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248128:0@lo:101: 00010000:00010000:2.0:1788927262.304494:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.304507:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927262.304897:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248256:0@lo:501: 00000100:00100000:3.0:1788927262.304955:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927262.305069:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd7c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.308710:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248256 00000100:00100000:1.0:1788927262.308723:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248256 00000100:00100000:1.0:1788927262.309301:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788927262.309312:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075248256:12345-0@lo:501: 00000100:00100000:1.0:1788927262.309481:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075248256:12345-0@lo:501: Request processed in 170us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927262.309489:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788927262.310005:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248256:0@lo:501: 00000100:00100000:3.0:1788927262.310059:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248384:0@lo:503: 00000100:00100000:3.0:1788927262.310163:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927262.310201:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd7c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.310249:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248384 00000100:00100000:1.0:1788927262.310255:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248384 00000100:00100000:1.0:1788927262.310315:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788927262.310323:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075248384:12345-0@lo:503: 00000100:00100000:1.0:1788927262.310407:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075248384:12345-0@lo:503: Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927262.310415:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788927262.310465:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248384:0@lo:503: 00000100:00100000:2.0:1788927262.316968:0:7311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7311:1875826075248512:0@lo:502: 00000100:00100000:2.0:1788927262.317049:0:7311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.317139:0:7311:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.317217:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248512 00000100:00100000:1.0:1788927262.317294:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248512 00000100:00100000:1.0:1788927262.317345:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788927262.317355:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:7311:x1875826075248512:12345-0@lo:502: 00000100:00100000:1.0:1788927262.317477:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:7311:x1875826075248512:12345-0@lo:502: Request processed in 123us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927262.317485:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788927262.317571:0:7311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7311:1875826075248512:0@lo:502: 00000100:00100000:2.0:1788927262.317655:0:7311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7311:1875826075248640:0@lo:502: 00000100:00100000:2.0:1788927262.317687:0:7311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.317710:0:7311:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.317901:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248640 00000100:00100000:1.0:1788927262.317906:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248640 00000100:00100000:1.0:1788927262.317930:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788927262.317937:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:7311:x1875826075248640:12345-0@lo:502: 00000100:00100000:1.0:1788927262.318012:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:7311:x1875826075248640:12345-0@lo:502: Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927262.318019:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788927262.318299:0:7311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7311:1875826075248640:0@lo:502: 00000040:00080000:2.0:1788927262.318321:0:7311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788927262.318880:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788927262.318901:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788927262.318911:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927262.318920:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927262.318929:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788927262.318931:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91895033f000 from 4 10000000:01000000:1.0:1788927262.318934:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788927262.318961:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927262.318969:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927262.318978:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927262.318991:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248768:0@lo:101: 00000100:00100000:1.0:1788927262.319029:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927262.319051:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918971b83900 going to sleep for 11 seconds 00000100:00100000:2.0:1788927262.319176:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248768 00000100:00100000:2.0:1788927262.319182:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248768 00000100:00100000:2.0:1788927262.319217:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788927262.319365:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075248768:12345-0@lo:101: 00010000:00010000:2.0:1788927262.319378:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927262.319461:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e938b expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927262.319485:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927262.319497:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927262.319506:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820dfa00, rc 0) 00000100:00100000:3.0:1788927262.319548:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075248768:12345-0@lo:101: Request processed in 323us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927262.319554:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788927262.319660:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248768:0@lo:101: 00010000:00010000:1.0:1788927262.319673:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927262.319695:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927262.319737:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248896:0@lo:256: 00000100:00100000:1.0:1788927262.319766:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927262.320123:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918971b83900 going to sleep for 11 seconds 00000100:00100000:2.0:1788927262.323371:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075248896 00000100:00100000:2.0:1788927262.323387:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075248896 00000100:00100000:2.0:1788927262.323448:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788927262.323459:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075248896:12345-0@lo:256: 20000000:01000000:2.0:1788927262.323486:0:5947:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788927262.323502:0:5947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788927262.323506:0:5947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788927262.323647:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075248896:12345-0@lo:256: Request processed in 190us (3879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.323655:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788927262.326678:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075248896:0@lo:256: 10000000:01000000:0.0:1788927262.326757:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788927262.326767:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.326840:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927262.326850:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788927262.326853:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788927262.326856:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788927262.326887:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.326895:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.326904:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927262.326920:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075249024:0@lo:101: 00000100:00100000:0.0:1788927262.326969:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927262.327003:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788927262.327359:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249024 00000100:00100000:3.0:1788927262.327366:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249024 00000100:00100000:3.0:1788927262.327411:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788927262.327420:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075249024:12345-0@lo:101: 00010000:00010000:3.0:1788927262.327433:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927262.327446:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9399 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927262.327468:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9399 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927262.327477:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9399 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927262.327497:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df000, rc 0) 00000100:00100000:3.0:1788927262.327536:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075249024:12345-0@lo:101: Request processed in 116us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927262.327541:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788927262.328772:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075249024:0@lo:101: 00010000:00010000:0.0:1788927262.328801:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.328812:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927262.328892:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075249152:0@lo:501: 00000100:00100000:0.0:1788927262.328937:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927262.328968:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788927262.329661:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249152 00000100:00100000:2.0:1788927262.329668:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249152 00000100:00100000:2.0:1788927262.329710:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788927262.329720:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075249152:12345-0@lo:501: 00000100:00100000:2.0:1788927262.329873:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075249152:12345-0@lo:501: Request processed in 155us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.329881:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788927262.329923:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075249152:0@lo:501: 00000100:00100000:2.0:1788927262.329955:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075249280:0@lo:503: 00000100:00100000:2.0:1788927262.330003:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.330022:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249280 00000100:00100000:2.0:1788927262.330025:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249280 00000100:00100000:2.0:1788927262.330052:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788927262.330058:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075249280:12345-0@lo:503: 00000100:00100000:2.0:1788927262.330237:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075249280:12345-0@lo:503: Request processed in 168us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.330244:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788927262.330272:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927262.330282:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075249280:0@lo:503: 00000100:00100000:3.0:1788927262.338449:0:7313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7313:1875826075249408:0@lo:502: 00000100:00100000:3.0:1788927262.338526:0:7313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927262.338575:0:7313:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd7c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.338665:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249408 00000100:00100000:1.0:1788927262.338672:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249408 00000100:00100000:1.0:1788927262.338724:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788927262.338734:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+15:7313:x1875826075249408:12345-0@lo:502: 00000100:00100000:1.0:1788927262.338856:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+15:7313:x1875826075249408:12345-0@lo:502: Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927262.338864:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788927262.339266:0:7313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7313:1875826075249408:0@lo:502: 00000020:01000000:3.0:1788927262.339298:0:7313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788927262.339306:0:7313:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788927262.339313:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927262.339315:0:7313:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788927262.339319:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788927262.339323:0:7313:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.154@tcp to nid 0x20000c0a8cb9a (192.168.203.154@tcp) 00000020:01000000:3.0:1788927262.339346:0:7313:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788927262.339349:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788927262.339363:0:7313:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9189494db370) 00000020:00000080:3.0:1788927262.339382:0:7313:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788927262.339388:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788927262.339462:0:7313:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788927262.339468:0:7313:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788927262.339475:0:7313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e93ae 00010000:00080000:3.0:1788927262.339503:0:7313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff918842fa7800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.154@tcp at head 00010000:00010000:3.0:1788927262.339750:0:7313:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788927262.357898:0:7313:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788927262.357920:0:7313:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788927262.358156:0:7313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927262.358511:0:7313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927262.358590:0:7313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788927262.358865:0:7313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788927262.359250:0:7316:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788927262.359255:0:7316:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788927262.359967:0:7313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788927262.359978:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788927262.360011:0:7313:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788927262.360030:0:7313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x750239bd504e93b5 00000100:00080000:1.0:1788927262.360039:0:7313:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788927262.360045:0:7313:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff918842fa7800 using connection 192.168.203.154@tcp/0@lo 00000100:00100000:1.0:1788927262.360079:0:7313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91894593ca80 x1875826075249536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788927262.360342:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1875826075249536:0@lo:8: 00000100:00100000:3.0:1788927262.360417:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788927262.360488:0:7313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788927262.360616:0:7313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927262.360620:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927262.360628:0:7313:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788927262.360631:0:7313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927262.360635:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927262.360637:0:7313:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788927262.360639:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788927262.360641:0:7313:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788927262.360663:0:7313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7313:1875826075249920:0@lo:502: 00000100:00100000:1.0:1788927262.360706:0:7313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927262.360728:0:7313:0:(client.c:2715:ptlrpc_set_wait()) set ffff918961d6e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927262.365987:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249536 00000100:00100000:0.0:1788927262.366002:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249536 00000100:00100000:0.0:1788927262.366039:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788927262.366047:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3442:x1875826075249536:12345-0@lo:8: 00010000:00080000:0.0:1788927262.366073:0:6941:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1788927262.366113:0:6941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x750239bd504e93bc 00002000:00100000:0.0:1788927262.366158:0:6941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff918842fb4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788927262.366163:0:6941:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788927262.366167:0:6941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788927262.366224:0:6941:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788927262.366881:0:6941:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788927262.366907:0:6941:0:(import.c:65:import_set_state_nolock()) ffff918842fb1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788927262.367869:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075249664:0@lo:400: 00000100:00100000:2.0:1788927262.367916:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.367965:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927262.367974:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075249792:0@lo:400: 00000100:00100000:2.0:1788927262.367997:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.368033:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249664 00000100:00100000:2.0:1788927262.368038:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249664 00000100:00100000:2.0:1788927262.368074:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249792 00000100:00100000:2.0:1788927262.368077:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249792 00000100:00100000:2.0:1788927262.368113:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788927262.368121:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075249664:12345-0@lo:400: 00000100:00100000:2.0:1788927262.368164:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075249664:12345-0@lo:400: Request processed in 44us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.368170:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788927262.368185:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788927262.368191:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075249792:12345-0@lo:400: 00000100:00100000:2.0:1788927262.368218:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075249792:12345-0@lo:400: Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.368224:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788927262.368259:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788927262.368291:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593fb80 x1875826075249664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927262.368303:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075249664:0@lo:400: 00010000:00080000:2.0:1788927262.368328:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593df80 x1875826075249792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927262.368336:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075249792:0@lo:400: 00000100:00100000:2.0:1788927262.368352:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075249920 00000100:00100000:2.0:1788927262.368355:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075249920 00000100:00100000:2.0:1788927262.368378:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788927262.368384:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:7313:x1875826075249920:12345-0@lo:502: 00000100:00100000:2.0:1788927262.368485:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:7313:x1875826075249920:12345-0@lo:502: Request processed in 100us (7778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.368492:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788927262.368539:0:7313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:7313:1875826075249920:0@lo:502: 00000020:01000000:2.0:1788927262.368564:0:7313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788927262.368571:0:7313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788927262.368573:0:7313:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788927262.368577:0:7313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788927262.368652:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788927262.368669:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788927262.368678:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.368689:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927262.368698:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788927262.368706:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9189491499b8 from 1 10000000:01000000:2.0:1788927262.368709:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788927262.368736:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.368744:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.368752:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927262.368767:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075250048:0@lo:101: 00000100:00100000:2.0:1788927262.368796:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.368820:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974bf4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788927262.369940:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1875826075249536:12345-0@lo:8: Request processed in 3887us (9516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927262.369952:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788927262.371301:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250048 00000100:00100000:2.0:1788927262.371313:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250048 00000100:00100000:2.0:1788927262.371362:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788927262.371371:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075250048:12345-0@lo:101: 00010000:00010000:2.0:1788927262.371387:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927262.371405:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e93c3 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.371432:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e93c3 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.371443:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e93c3 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.371451:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189413c8a00, rc 0) 00000100:00100000:2.0:1788927262.371514:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075250048:12345-0@lo:101: Request processed in 144us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927262.371533:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788927262.371581:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075250048:0@lo:101: 00010000:00010000:2.0:1788927262.371612:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927262.371621:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927262.371682:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075250176:0@lo:501: 00000100:00100000:2.0:1788927262.371714:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.371743:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974bf4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788927262.371757:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250176 00000100:00100000:2.0:1788927262.371760:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250176 00000100:00100000:2.0:1788927262.371912:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788927262.371920:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075250176:12345-0@lo:501: 00000100:00100000:2.0:1788927262.371997:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075250176:12345-0@lo:501: Request processed in 78us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788927262.372004:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788927262.372113:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075250176:0@lo:501: 10000000:01000000:0.0:1788927262.372140:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788927262.372152:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927262.372159:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788927262.375400:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593ca80 x1875826075249536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788927272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927262.375416:0:3442:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788927262.375427:0:3442:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788927262.375435:0:3442:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788927262.375441:0:3442:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788927262.375445:0:3442:0:(import.c:65:import_set_state_nolock()) ffff918842fa7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788927262.375471:0:3442:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788927262.375477:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1875826075249536:0@lo:8: 00000004:00080000:1.0:1788927262.376892:0:7316:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788927262.376964:0:7316:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 211501367907ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788927262.376972:0:7316:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788927262.384765:0:5933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788927262.387110:0:7317:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788927262.387145:0:7317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250432:0@lo:7: 00000100:00100000:0.0:1788927262.387228:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075250304:0@lo:13: 00000100:00100000:1.0:1788927262.387233:0:7317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927262.387265:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927262.387274:0:7317:0:(client.c:2715:ptlrpc_set_wait()) set ffff918961d6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927262.387299:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250432 00000100:00100000:0.0:1788927262.387306:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250432 00000100:00100000:0.0:1788927262.387369:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927262.387378:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7317:x1875826075250432:12345-0@lo:7: 00000100:00080000:1.0:1788927262.388177:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788927262.390001:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250304 00000100:00100000:1.0:1788927262.390013:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250304 00000100:00100000:1.0:1788927262.390061:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927262.390070:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3444:x1875826075250304:12345-0@lo:13: 00002000:00000024:1.0:1788927262.390112:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923902464 avail 3692380160 00000100:00100000:1.0:1788927262.390182:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3444:x1875826075250304:12345-0@lo:13: Request processed in 113us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927262.390188:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1788927262.396534:0:6943:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788927262.396543:0:6943:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788927262.396750:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7317:x1875826075250432:12345-0@lo:7: Request processed in 9369us (9526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927262.396761:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788927262.396887:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593e300 x1875826075250304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927262.396910:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075250304:0@lo:13: 00010000:00080000:2.0:1788927262.400290:0:7317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593d500 x1875826075250432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788927278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927262.400308:0:7317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250432:0@lo:7: 00000004:00080000:2.0:1788927262.400323:0:7317:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788927262.402963:0:7317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250560:0@lo:5: 00000100:00100000:3.0:1788927262.403033:0:7317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927262.403082:0:7317:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd7c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.403123:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250560 00000100:00100000:1.0:1788927262.403131:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250560 00000100:00100000:1.0:1788927262.403186:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927262.403196:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7317:x1875826075250560:12345-0@lo:5: 00002000:00080000:1.0:1788927262.403249:0:6941:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788927262.403252:0:6941:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788927262.416385:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788927262.416402:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788927262.416687:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7317:x1875826075250560:12345-0@lo:5: Request processed in 13488us (13649us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788927262.416698:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788927262.416807:0:7317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff918945928a80 x1875826075250560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788927278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927262.416819:0:7317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788927262.416835:0:7317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250560:0@lo:5: 00000004:00080000:2.0:1788927262.416850:0:7317:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788927262.416900:0:7317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250688:0@lo:700: 00000100:00100000:2.0:1788927262.416938:0:7317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.416978:0:7317:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974bf4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788927262.417104:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250688 00000100:00100000:1.0:1788927262.417110:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250688 00000100:00100000:1.0:1788927262.417157:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927262.417166:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7317:x1875826075250688:12345-0@lo:700: 00000100:00100000:1.0:1788927262.417200:0:6949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6949:1875826075250816:0@lo:700: 00000100:00100000:1.0:1788927262.417229:0:6949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927262.419209:0:6949:0:(client.c:2715:ptlrpc_set_wait()) set ffff918961d6ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788927262.419388:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250816 00000100:00100000:3.0:1788927262.419397:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250816 00000100:00100000:3.0:1788927262.419479:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788927262.419490:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6949:x1875826075250816:12345-0@lo:700: 40000000:02000000:3.0:1788927262.428717:0:5961:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788927262.437849:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6949:x1875826075250816:12345-0@lo:700: Request processed in 18353us (20610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927262.437862:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788927262.437918:0:6949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593ce00 x1875826075250816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788927278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927262.437933:0:6949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6949:1875826075250816:0@lo:700: 40000000:02000000:3.0:1788927262.437946:0:6949:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788927262.472713:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7317:x1875826075250688:12345-0@lo:700: Request processed in 55540us (55767us total) trans 0 rc 0/0 00010000:00080000:0.0:1788927262.472724:0:7317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9189605c0e00 x1875826075250688/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788927278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927262.472729:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788927262.472746:0:7317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250688:0@lo:700: 00000004:02000040:0.0:1788927262.486269:0:7317:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788927262.502898:0:7317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250944:0@lo:5: 00000100:00100000:2.0:1788927262.502969:0:7317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927262.503024:0:7317:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974bf4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788927262.503985:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075250944 00000100:00100000:0.0:1788927262.504001:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075250944 00000100:00100000:0.0:1788927262.504058:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788927262.504068:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7317:x1875826075250944:12345-0@lo:5: 00002000:00080000:0.0:1788927262.534220:0:6943:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788927262.534239:0:6943:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788927262.535996:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7317:x1875826075250944:12345-0@lo:5: Request processed in 31923us (33022us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788927262.536008:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788927262.536175:0:7317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9189605c0000 x1875826075250944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788927278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927262.536194:0:7317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7317:1875826075250944:0@lo:5: 00000004:00080000:2.0:1788927262.536208:0:7317:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788927262.624887:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788927263.205028:0:7361:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788927263.205253:0:7361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788927263.643354:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788927264.269168:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788927264.666777:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927265.690974:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788927266.186326:0:7463:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788927266.186521:0:7463:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788927266.715792:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788927267.021115:0:7511:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788927267.021129:0:7511:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788927267.418890:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075251200:0@lo:400: 00000100:00100000:0.0:1788927267.418967:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927267.419032:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075251072:0@lo:400: 00000100:00100000:0.0:1788927267.419062:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075251456:0@lo:400: 00000100:00100000:3.0:1788927267.419078:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927267.419086:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927267.419101:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788927267.419107:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075251328:0@lo:400: 00000100:00100000:0.0:1788927267.419133:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927267.419337:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251200 00000100:00100000:1.0:1788927267.419346:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251200 00000100:00100000:1.0:1788927267.419395:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251328 00000100:00100000:1.0:1788927267.419399:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251328 00000100:00100000:1.0:1788927267.419428:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788927267.419437:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075251200:12345-0@lo:400: 00000100:00100000:1.0:1788927267.419492:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075251200:12345-0@lo:400: Request processed in 56us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927267.419499:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788927267.419515:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788927267.419534:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075251328:12345-0@lo:400: 00000100:00100000:1.0:1788927267.419583:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075251328:12345-0@lo:400: Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927267.419588:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788927267.419629:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251456 00000100:00100000:1.0:1788927267.419632:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251456 00000100:00100000:1.0:1788927267.419657:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788927267.419663:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075251456:12345-0@lo:400: 00000100:00100000:1.0:1788927267.419690:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075251456:12345-0@lo:400: Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927267.419696:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788927267.419712:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788927267.419716:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788927267.419742:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593e680 x1875826075251328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927267.419760:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075251328:0@lo:400: 00010000:00080000:1.0:1788927267.419772:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593df80 x1875826075251456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927267.419779:0:3444:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788927267.419790:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075251456:0@lo:400: 00010000:00080000:1.0:1788927267.419812:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593ca80 x1875826075251200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927267.419821:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075251200:0@lo:400: 00000100:00100000:2.0:1788927267.419941:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251072 00000100:00100000:2.0:1788927267.419945:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251072 00000100:00100000:2.0:1788927267.419972:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788927267.419979:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+16:3445:x1875826075251072:12345-0@lo:400: 00000100:00100000:2.0:1788927267.420023:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+16:3445:x1875826075251072:12345-0@lo:400: Request processed in 45us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927267.420029:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788927267.420370:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075251584:0@lo:13: 00000100:00100000:1.0:1788927267.420400:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927267.420442:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075251072:0@lo:400: 00000100:00100000:0.0:1788927267.420510:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251584 00000100:00100000:0.0:1788927267.420515:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251584 00000100:00100000:0.0:1788927267.420558:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927267.420567:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075251584:12345-0@lo:13: 00002000:00000024:0.0:1788927267.420588:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927267.420637:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075251584:12345-0@lo:13: Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927267.420644:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788927267.422189:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9189605c1c00 x1875826075251584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927267.422212:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075251584:0@lo:13: 00010000:00010000:0.0:1788927267.739031:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927268.765661:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927269.786949:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927270.813005:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927271.836719:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927272.538736:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075251712:0@lo:13: 00000100:00100000:1.0:1788927272.538820:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927272.538911:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251712 00000100:00100000:1.0:1788927272.538920:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251712 00000100:00100000:1.0:1788927272.538993:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927272.539004:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075251712:12345-0@lo:13: 00002000:00000024:1.0:1788927272.539058:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927272.539106:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075251712:12345-0@lo:13: Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927272.539114:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788927272.539138:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788927272.539174:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593e300 x1875826075251712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927272.539194:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075251712:0@lo:13: 00000100:00100000:3.0:1788927272.540105:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075251840:0@lo:400: 00000100:00100000:3.0:1788927272.540154:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927272.540190:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927272.540196:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075251968:0@lo:400: 00000100:00100000:3.0:1788927272.540306:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927272.540335:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251840 00000100:00100000:3.0:1788927272.540341:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251840 00000100:00100000:3.0:1788927272.540394:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788927272.540404:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:3443:x1875826075251840:12345-0@lo:400: 00000100:00100000:3.0:1788927272.540447:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:3443:x1875826075251840:12345-0@lo:400: Request processed in 44us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927272.540454:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788927272.540496:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075251840:0@lo:400: 00000100:00100000:1.0:1788927272.542391:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075251968 00000100:00100000:1.0:1788927272.542408:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075251968 00000100:00100000:1.0:1788927272.542488:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788927272.542500:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075251968:12345-0@lo:400: 00000100:00100000:1.0:1788927272.542626:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075251968:12345-0@lo:400: Request processed in 129us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927272.542635:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788927272.542667:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075252096:0@lo:400: 00000100:00100000:1.0:1788927272.542704:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927272.542746:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252096 00000100:00100000:1.0:1788927272.542750:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252096 00000100:00100000:1.0:1788927272.542781:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788927272.542787:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075252096:12345-0@lo:400: 00000100:00100000:1.0:1788927272.542823:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075252096:12345-0@lo:400: Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927272.542829:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788927272.542844:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788927272.542873:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894592a300 x1875826075252096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927272.542887:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075252096:0@lo:400: 00010000:00080000:1.0:1788927272.542920:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894592a680 x1875826075251968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927272.542993:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075251968:0@lo:400: 00010000:00010000:1.0:1788927272.863648:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927273.888564:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927274.908955:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927275.931029:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927276.955829:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788927277.132651:0:8009:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788927277.132655:0:8009:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788927277.132657:0:8009:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788927277.132806:0:8009:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9188410d4800 00000020:01000004:3.0:1788927277.132822:0:8009:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788927277.132835:0:8009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788927277.132857:0:8009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff918843aecd28) 00000020:00000080:3.0:1788927277.132873:0:8009:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788927277.217899:0:8009:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788927277.217961:0:8009:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788927277.266507:0:8009:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788927277.272308:0:8009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788927277.272331:0:8009:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788927277.272343:0:8009:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x750239bd504e93d8 00000020:01000004:0.0:1788927277.272351:0:8009:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788927277.272372:0:8009:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788927277.272375:0:8009:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788927277.272380:0:8009:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788927277.272412:0:8009:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788927277.272417:0:8009:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788927277.308456:0:8009:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788927277.308495:0:8009:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.154@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788927277.308499:0:8009:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788927277.308505:0:8009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788927277.308507:0:8009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927277.308508:0:8009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927277.308509:0:8009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927277.308511:0:8009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927277.308512:0:8009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788927277.308513:0:8009:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927277.308514:0:8009:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927277.308516:0:8009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927277.308517:0:8009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788927277.308521:0:8009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788927277.308523:0:8009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788927277.308524:0:8009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788927277.308525:0:8009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927277.308526:0:8009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927277.308527:0:8009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927277.308527:0:8009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927277.308528:0:8009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788927277.308529:0:8009:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927277.308530:0:8009:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927277.308531:0:8009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927277.308532:0:8009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788927277.308568:0:8009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788927277.308585:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075252224:0@lo:253: 00000100:00100000:2.0:1788927277.308773:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.308821:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974bf4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.308895:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252224 00000100:00100000:0.0:1788927277.308903:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252224 00000100:00100000:0.0:1788927277.308958:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788927277.308966:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:8009:x1875826075252224:12345-0@lo:253: 20000000:01000000:0.0:1788927277.309009:0:5947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788927277.309014:0:5947:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788927277.309018:0:5947:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788927277.309021:0:5947:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788927277.309207:0:5947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927277.309326:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788927277.309341:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788927277.309358:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788927277.309365:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788927277.309378:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788927277.309392:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788927277.309473:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788927277.309487:0:5947:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.154@tcp 20000000:01000000:0.0:1788927277.309489:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788927277.309518:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788927277.309529:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788927277.309543:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788927277.309548:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.154@tcp (null) (null) 00000040:00080000:0.0:1788927277.309558:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788927277.309563:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788927277.309573:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788927277.309584:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788927277.313411:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788927277.313441:0:5947:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.154@tcp 20000000:01000000:0.0:1788927277.313444:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.154@tcp (null) (null) (null) 00000040:00080000:0.0:1788927277.313460:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788927277.313467:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788927277.313480:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788927277.313485:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.154@tcp (null) (null) 00000040:00080000:0.0:1788927277.313500:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788927277.313507:0:5947:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788927277.313518:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788927277.313533:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788927277.313545:0:5947:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788927277.313547:0:5947:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788927277.313551:0:5947:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788927277.313593:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788927277.313616:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788927277.314949:0:8015:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788927277.314982:0:8015:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788927277.315008:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788927277.315331:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788927277.315371:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788927277.315386:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788927277.315399:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788927277.315401:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788927277.315918:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788927277.316195:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788927277.316214:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788927277.316226:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788927277.316234:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788927277.316236:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788927277.317546:0:8017:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788927277.317585:0:8017:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788927277.319210:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788927277.319458:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788927277.319506:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788927277.319523:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788927277.319534:0:5947:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788927277.319537:0:5947:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788927277.320102:0:8018:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788927277.320133:0:8018:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788927277.320154:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788927277.320306:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788927277.320326:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788927277.320340:0:5947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788927277.320353:0:5947:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788927277.320372:0:5947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320389:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9329 expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320398:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9353 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320404:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e937d expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320411:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9399 expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320417:0:5947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e93c3 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320425:0:5947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320463:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e93c3 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320478:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e93c3 expref: 16 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.320501:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252352:0@lo:104: 00000100:00100000:2.0:1788927277.320565:0:5947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788927277.320794:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9399 expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320804:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9399 expref: 16 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.320812:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252480:0@lo:104: 00010000:00010000:2.0:1788927277.320839:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e937d expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320847:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e937d expref: 16 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.320855:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252608:0@lo:104: 00010000:00010000:2.0:1788927277.320890:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9353 expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320898:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9353 expref: 16 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.320907:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252736:0@lo:104: 00010000:00010000:2.0:1788927277.320935:0:5947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9329 expref: 16 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.320943:0:5947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9329 expref: 16 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.320961:0:5947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252864:0@lo:104: 00000100:00100000:2.0:1788927277.320980:0:5947:0:(client.c:2715:ptlrpc_set_wait()) set ffff918961d6e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927277.321155:0:5938:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788927277.321176:0:5938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.321270:0:5938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.321334:0:5938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.321353:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252352 00000100:00100000:3.0:1788927277.321360:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252352 00000100:00100000:3.0:1788927277.321389:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252480 00000100:00100000:3.0:1788927277.321397:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252480 00000100:00100000:3.0:1788927277.325285:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252608 00000100:00100000:3.0:1788927277.325297:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252608 00000100:00100000:3.0:1788927277.325332:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788927277.325341:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+5:5947:x1875826075252352:12345-0@lo:104: 00010000:00010000:3.0:1788927277.325360:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325467:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788927277.325473:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+5:5947:x1875826075252352:12345-0@lo:104: Request processed in 133us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.325480:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788927277.325519:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788927277.325525:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+4:5947:x1875826075252480:12345-0@lo:104: 00010000:00010000:3.0:1788927277.325534:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325567:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788927277.325571:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+4:5947:x1875826075252480:12345-0@lo:104: Request processed in 48us (4396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.325577:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788927277.325589:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788927277.325689:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252352:0@lo:104: 00000100:00100000:2.0:1788927277.325700:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252480:0@lo:104: 00000100:00100000:3.0:1788927277.325747:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:5947:x1875826075252608:12345-0@lo:104: 00010000:00010000:3.0:1788927277.325756:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325827:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788927277.325832:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:5947:x1875826075252608:12345-0@lo:104: Request processed in 237us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.325851:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788927277.325873:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788927277.325880:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325897:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189413c9200 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927277.325901:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325910:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927277.325917:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.325923:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788927277.325958:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325964:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927277.325980:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.325998:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e93c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93ca expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326010:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788927277.326013:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326029:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0000 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927277.326032:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326039:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927277.326045:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.326050:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788927277.326064:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326069:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927277.326083:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326091:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918842fc0000/0x750239bd504e9399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93a0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326100:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788927277.326103:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326108:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927277.326110:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326127:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927277.326133:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.326137:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788927277.326151:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326156:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927277.326161:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326166:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e937d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9384 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326176:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.326177:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.326179:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.326185:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927277.326203:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075252992:0@lo:103: 00000100:00100000:3.0:1788927277.326238:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.326283:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075253120:0@lo:103: 00000100:00100000:3.0:1788927277.326307:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.326323:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927277.326329:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075253248:0@lo:103: 00000100:00100000:3.0:1788927277.326348:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.326384:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252992 00000100:00100000:3.0:1788927277.326388:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252992 00010000:00010000:3.0:1788927277.326406:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e93c3 expref: 17 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927277.326419:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253120 00000100:00100000:3.0:1788927277.326422:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253120 00010000:00010000:3.0:1788927277.326432:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9399 expref: 18 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927277.326440:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253248 00000100:00100000:3.0:1788927277.326442:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253248 00010000:00010000:3.0:1788927277.326451:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e937d expref: 19 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927277.326461:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788927277.326468:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075252992:12345-0@lo:103: 00010000:00010000:3.0:1788927277.326478:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927277.326483:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e93c3 expref: 19 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326494:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e93c3 expref: 19 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326510:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189413c8a00/0x750239bd504e93ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e93c3 expref: 19 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326523:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927277.326552:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+18:3446:x1875826075252992:12345-0@lo:103: Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.326559:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788927277.326579:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788927277.326586:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+17:3443:x1875826075253120:12345-0@lo:103: 00010000:00010000:3.0:1788927277.326593:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927277.326617:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9399 expref: 17 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326626:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9399 expref: 17 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326637:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820df000/0x750239bd504e93a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9399 expref: 17 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326646:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927277.326672:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+16:3443:x1875826075253120:12345-0@lo:103: Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.326678:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788927277.326690:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788927277.326696:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+15:3443:x1875826075253248:12345-0@lo:103: 00010000:00010000:3.0:1788927277.326703:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927277.326706:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e937d expref: 15 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326714:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e937d expref: 15 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.326723:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927277.326743:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+15:3443:x1875826075253248:12345-0@lo:103: Request processed in 47us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.326749:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788927277.326788:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075252992:0@lo:103: 00000100:00100000:3.0:1788927277.326810:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075253248:0@lo:103: 00000100:00100000:3.0:1788927277.326817:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075253120:0@lo:103: 00000100:00100000:1.0:1788927277.327273:0:5938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.327294:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252736 00000100:00100000:1.0:1788927277.327299:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252736 00000100:00100000:1.0:1788927277.327319:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075252864 00000100:00100000:1.0:1788927277.327321:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075252864 00000100:00100000:1.0:1788927277.327334:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788927277.327340:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+4:5947:x1875826075252736:12345-0@lo:104: 00010000:00010000:1.0:1788927277.327349:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.327389:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788927277.327394:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+4:5947:x1875826075252736:12345-0@lo:104: Request processed in 55us (6060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927277.327401:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788927277.327414:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788927277.327420:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5947:x1875826075252864:12345-0@lo:104: 00010000:00010000:1.0:1788927277.327428:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.327455:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788927277.327459:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5947:x1875826075252864:12345-0@lo:104: Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927277.327466:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788927277.327518:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788927277.327524:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327531:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1200 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927277.327534:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327542:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927277.327549:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.327555:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788927277.327697:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327711:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927277.327732:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327739:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918842fc1200/0x750239bd504e9353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e935a expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327750:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788927277.327769:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327776:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820de600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927277.327779:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.327786:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927277.327792:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.327798:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788927277.327829:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075253376:0@lo:103: 00000100:00100000:0.0:1788927277.327865:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788927277.329058:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc1a00/0x750239bd504e9384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e937d expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.329072:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252608:0@lo:104: 00000100:00100000:2.0:1788927277.329083:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252736:0@lo:104: 00000100:00100000:2.0:1788927277.329091:0:5947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5947:1875826075252864:0@lo:104: 00010000:00010000:2.0:1788927277.329117:0:5947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.329703:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.329773:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.329783:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788927277.329819:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788927277.329837:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.329846:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189820de600/0x750239bd504e9329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9330 expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.329861:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.329863:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.329866:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927277.329895:0:5940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253376 00000100:00100000:3.0:1788927277.329901:0:5940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253376 00010000:00010000:3.0:1788927277.329928:0:5940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9353 expref: 14 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927277.329978:0:5940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788927277.329996:0:5940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+14:3445:x1875826075253376:12345-0@lo:103: 00010000:00010000:3.0:1788927277.330008:0:5940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927277.330014:0:5940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9353 expref: 14 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.330024:0:5940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9353 expref: 14 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.330038:0:5940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820dfe00/0x750239bd504e935a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9353 expref: 14 pid: 5947 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.330050:0:5940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927277.330231:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075253504:0@lo:103: 00000100:00100000:0.0:1788927277.330269:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.330534:0:5939:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788927277.330543:0:5939:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788927277.330797:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253504 00000100:00100000:2.0:1788927277.330803:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253504 00010000:00010000:2.0:1788927277.330820:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9329 expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.330841:0:5939:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788927277.330848:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788927277.330855:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+14:3445:x1875826075253504:12345-0@lo:103: 00010000:00010000:2.0:1788927277.330863:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927277.330868:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9329 expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330894:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9329 expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330909:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951779000/0x750239bd504e9330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9329 expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330923:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330930:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330942:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330949:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330957:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330963:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330969:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189413c9600 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:2.0:1788927277.330973:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.330980:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.331013:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.331022:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927277.331057:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+13:3445:x1875826075253504:12345-0@lo:103: Request processed in 202us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927277.331064:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788927277.331234:0:5947:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.331242:0:5947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.331248:0:5947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189413c9600/0x750239bd504e93df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788927277.331261:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788927277.332059:0:5940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b70cda-d4d0-488a-a813-7f141061abda+12:3445:x1875826075253376:12345-0@lo:103: Request processed in 2068us (4188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.332121:0:5940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788927277.332289:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075253376:0@lo:103: 00000100:00100000:0.0:1788927277.332314:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075253504:0@lo:103: 00000100:00100000:2.0:1788927277.333860:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+11:8009:x1875826075252224:12345-0@lo:253: Request processed in 24888us (25081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927277.333873:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788927277.334036:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075252224:0@lo:253: 10000000:01000000:1.0:1788927277.334051:0:8009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788927277.334054:0:8009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788927277.334056:0:8009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788927277.334057:0:8009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788927277.334058:0:8009:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788927277.334059:0:8009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788927277.334234:0:8009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788927277.334236:0:8009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788927277.334238:0:8009:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788927277.334239:0:8009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788927277.334240:0:8009:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788927277.334261:0:8009:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9188410d4800 from lustre-OST0001 10000000:01000000:1.0:1788927277.334289:0:8009:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788927277.334292:0:8009:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788927277.334300:0:8009:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9189491499b8 local copy 10000000:01000000:1.0:1788927277.334304:0:8009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788927277.334338:0:8009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.334348:0:8009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.334357:0:8009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927277.334374:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075253632:0@lo:101: 00000100:00100000:1.0:1788927277.334410:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.334437:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52000 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.334505:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253632 00000100:00100000:3.0:1788927277.334512:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253632 00000100:00100000:3.0:1788927277.334558:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788927277.334568:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+11:8009:x1875826075253632:12345-0@lo:101: 00010000:00010000:3.0:1788927277.334580:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927277.334592:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820df400/0x750239bd504e93ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e93e6 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.334641:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820df400/0x750239bd504e93ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e93e6 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.334650:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820df400/0x750239bd504e93ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e93e6 expref: 12 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.334665:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df400, rc 0) 00000100:00100000:3.0:1788927277.334713:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075253632:12345-0@lo:101: Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.334719:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788927277.335093:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075253632:0@lo:101: 00010000:00010000:1.0:1788927277.335108:0:8009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.335117:0:8009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927277.335214:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075253760:0@lo:501: 00000100:00100000:1.0:1788927277.335243:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.335283:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52000 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.342270:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253760 00000100:00100000:3.0:1788927277.342284:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253760 00000100:00100000:3.0:1788927277.342355:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788927277.342367:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075253760:12345-0@lo:501: 00000100:00100000:3.0:1788927277.342499:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075253760:12345-0@lo:501: Request processed in 135us (7255us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788927277.342507:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788927277.345242:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075253760:0@lo:501: 10000000:01000000:1.0:1788927277.345273:0:8009:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788927277.345316:0:8009:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788927277.345324:0:8009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.345334:0:8009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.345341:0:8009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.345369:0:8009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788927277.345401:0:8009:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9188410d4800 10000000:01000000:1.0:1788927277.345407:0:8009:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788927277.345412:0:8009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788927277.345415:0:8009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788927277.345419:0:8009:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788927277.345422:0:8009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788927277.345454:0:8009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.345462:0:8009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.345472:0:8009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927277.345490:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075253888:0@lo:101: 00000100:00100000:1.0:1788927277.345557:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.345587:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.345790:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075253888 00000100:00100000:0.0:1788927277.345797:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075253888 00000100:00100000:0.0:1788927277.345851:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788927277.345863:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075253888:12345-0@lo:101: 00010000:00010000:0.0:1788927277.345874:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927277.345897:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e93f4 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.345920:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e93f4 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.345930:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e93f4 expref: 13 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.345939:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0400, rc 0) 00000100:00100000:0.0:1788927277.345975:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075253888:12345-0@lo:101: Request processed in 115us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.345981:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1788927277.346196:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788927277.346204:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.346211:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779200 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927277.346215:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.346224:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927277.346231:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.346238:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788927277.346257:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.346276:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927277.346304:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.346311:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779200/0x750239bd504e93e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x750239bd504e93ed expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.346326:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.346327:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927277.346329:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927277.346336:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927277.346347:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075254016:0@lo:103: 00000100:00100000:3.0:1788927277.346378:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.346411:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254016 00000100:00100000:3.0:1788927277.346415:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254016 00000100:00100000:3.0:1788927277.346447:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788927277.346455:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+13:3444:x1875826075254016:12345-0@lo:103: 00010000:00010000:3.0:1788927277.346464:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927277.346476:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820df400/0x750239bd504e93ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x750239bd504e93e6 expref: 13 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.346485:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927277.346513:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+12:3444:x1875826075254016:12345-0@lo:103: Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.346520:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788927277.346551:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075254016:0@lo:103: 00000100:00100000:1.0:1788927277.347427:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075253888:0@lo:101: 00010000:00010000:1.0:1788927277.347446:0:8009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.347462:0:8009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927277.347556:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254144:0@lo:501: 00000100:00100000:1.0:1788927277.347610:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.347633:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.347791:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254144 00000100:00100000:3.0:1788927277.347807:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254144 00000100:00100000:3.0:1788927277.347845:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788927277.347853:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254144:12345-0@lo:501: 00000100:00100000:3.0:1788927277.347977:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254144:12345-0@lo:501: Request processed in 122us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.347994:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788927277.348202:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254144:0@lo:501: 00000100:00100000:1.0:1788927277.348230:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254272:0@lo:503: 00000100:00100000:1.0:1788927277.348271:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.348293:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a529c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.348341:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254272 00000100:00100000:0.0:1788927277.348352:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254272 00000100:00100000:0.0:1788927277.348389:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788927277.348397:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254272:12345-0@lo:503: 00000100:00100000:0.0:1788927277.348477:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254272:12345-0@lo:503: Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.348483:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788927277.348632:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254272:0@lo:503: 00000040:00080000:1.0:1788927277.348858:0:8009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788927277.348938:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254400:0@lo:502: 00000100:00100000:1.0:1788927277.348971:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.348998:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.349241:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254400 00000100:00100000:3.0:1788927277.349247:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254400 00000100:00100000:3.0:1788927277.349283:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788927277.349292:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254400:12345-0@lo:502: 00000100:00100000:3.0:1788927277.349379:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254400:12345-0@lo:502: Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.349386:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788927277.349429:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254400:0@lo:502: 00000040:00080000:3.0:1788927277.349647:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788927277.349670:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788927277.349698:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788927277.349711:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788927277.349724:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788927277.349735:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788927277.349757:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254528:0@lo:502: 00000100:00100000:3.0:1788927277.349793:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.349809:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.349824:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254528 00000100:00100000:3.0:1788927277.349828:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254528 00000100:00100000:3.0:1788927277.349846:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788927277.349852:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254528:12345-0@lo:502: 00000100:00100000:3.0:1788927277.349998:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254528:12345-0@lo:502: Request processed in 131us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.350013:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788927277.350050:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254528:0@lo:502: 00000040:00080000:3.0:1788927277.350231:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788927277.350239:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788927277.353053:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788927277.353064:0:8020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788927277.353084:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927277.353086:0:8020:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788927277.353094:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788927277.353129:0:8020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff918844493370) 00000020:00000080:0.0:1788927277.353152:0:8020:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788927277.353158:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788927277.353228:0:8020:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9188410d4800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788927277.353236:0:8020:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788927277.353243:0:8020:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x750239bd504e9409 00010000:00010000:0.0:1788927277.364819:0:8020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788927277.365180:0:8020:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788927277.373165:0:8020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788927277.373510:0:8020:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788927277.382849:0:8020:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788927277.383317:0:8020:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788927277.394263:0:8020:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788927277.397658:0:8020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788927277.397671:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927277.399074:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927277.399077:0:8020:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788927277.399087:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927277.399092:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927277.399093:0:8020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788927277.399097:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788927277.399099:0:8020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788927277.399126:0:8020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927277.399129:0:8020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927277.399131:0:8020:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788927277.399135:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788927277.403849:0:8009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788927277.403912:0:8009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788927277.403930:0:8009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.403943:0:8009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927277.403954:0:8009:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9188410d4800 from 1 10000000:01000000:3.0:1788927277.403957:0:8009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788927277.404003:0:8009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.404012:0:8009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.404024:0:8009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927277.404046:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254656:0@lo:101: 00000100:00100000:3.0:1788927277.404111:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.404152:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.404683:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254656 00000100:00100000:0.0:1788927277.404690:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254656 00000100:00100000:0.0:1788927277.404742:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788927277.404751:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+12:8009:x1875826075254656:12345-0@lo:101: 00010000:00010000:0.0:1788927277.404764:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927277.404777:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9410 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.404802:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9410 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.404811:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9410 expref: 13 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.404834:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1000, rc 0) 00000100:00100000:0.0:1788927277.404896:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075254656:12345-0@lo:101: Request processed in 146us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.404904:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788927277.405267:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254656:0@lo:101: 00010000:00010000:3.0:1788927277.405282:0:8009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.405299:0:8009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927277.405395:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254784:0@lo:501: 00000100:00100000:3.0:1788927277.405425:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.405457:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927277.405510:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254784 00000100:00100000:1.0:1788927277.405516:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254784 00000100:00100000:1.0:1788927277.405551:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788927277.405559:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075254784:12345-0@lo:501: 00000100:00100000:1.0:1788927277.405684:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075254784:12345-0@lo:501: Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927277.405692:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788927277.406439:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254784:0@lo:501: 00000100:00100000:3.0:1788927277.406477:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254912:0@lo:503: 00000100:00100000:3.0:1788927277.406526:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.406551:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.407154:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075254912 00000100:00100000:0.0:1788927277.407160:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075254912 00000100:00100000:0.0:1788927277.407207:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788927277.407216:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075254912:12345-0@lo:503: 00000100:00100000:0.0:1788927277.407328:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075254912:12345-0@lo:503: Request processed in 113us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.407335:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788927277.407412:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075254912:0@lo:503: 00000040:00080000:2.0:1788927277.412119:0:8009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788927277.412215:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255040:0@lo:502: 00000100:00100000:2.0:1788927277.412291:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.412325:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.412412:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255040 00000100:00100000:3.0:1788927277.412420:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255040 00000100:00100000:3.0:1788927277.412463:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788927277.412473:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075255040:12345-0@lo:502: 00000100:00100000:3.0:1788927277.412622:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075255040:12345-0@lo:502: Request processed in 124us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.412630:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788927277.412798:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255040:0@lo:502: 00000040:00080000:2.0:1788927277.413810:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788927277.414031:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788927277.414129:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255168:0@lo:502: 00000100:00100000:2.0:1788927277.414196:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.414297:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.422415:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255168 00000100:00100000:3.0:1788927277.422430:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255168 00000100:00100000:3.0:1788927277.422499:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788927277.422511:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075255168:12345-0@lo:502: 00000100:00100000:3.0:1788927277.422835:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075255168:12345-0@lo:502: Request processed in 325us (8637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.422844:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788927277.427774:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255168:0@lo:502: 00000040:00080000:2.0:1788927277.428028:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788927277.428042:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788927277.435388:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927277.435402:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927277.435404:0:8024:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788927277.435411:0:8024:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9188410d4800 00000020:00000080:0.0:1788927277.435414:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788927277.435425:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927277.435427:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927277.435428:0:8024:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788927277.435432:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788927277.435644:0:8009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788927277.435680:0:8009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788927277.435697:0:8009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.435709:0:8009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927277.435757:0:8009:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788927277.435760:0:8009:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9188410d4800 10000000:01000000:2.0:1788927277.435762:0:8009:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9188410d4800 10000000:01000000:2.0:1788927277.435766:0:8009:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788927277.435771:0:8009:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9188410d4800 from 1 10000000:01000000:2.0:1788927277.435773:0:8009:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788927277.435816:0:8009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.435825:0:8009:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.435836:0:8009:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.435867:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255296:0@lo:101: 00000100:00100000:2.0:1788927277.436172:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.436214:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.436280:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255296 00000100:00100000:3.0:1788927277.436295:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255296 00000100:00100000:3.0:1788927277.436337:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788927277.436346:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:8009:x1875826075255296:12345-0@lo:101: 00010000:00010000:3.0:1788927277.436359:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927277.436370:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e941e expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.436392:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e941e expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.436402:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e941e expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927277.436410:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820dfe00, rc 0) 00000100:00100000:3.0:1788927277.436459:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255296:12345-0@lo:101: Request processed in 114us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.436466:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788927277.436773:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255296:0@lo:101: 00010000:00010000:2.0:1788927277.436797:0:8009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.436807:0:8009:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.437004:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255424:0@lo:501: 00000100:00100000:2.0:1788927277.437036:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.437063:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.437119:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255424 00000100:00100000:3.0:1788927277.437124:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255424 00000100:00100000:3.0:1788927277.437157:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788927277.437165:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255424:12345-0@lo:501: 00000100:00100000:3.0:1788927277.437269:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255424:12345-0@lo:501: Request processed in 105us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.437276:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788927277.437384:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255424:0@lo:501: 00000100:00100000:2.0:1788927277.437411:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255552:0@lo:503: 00000100:00100000:2.0:1788927277.437450:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.437472:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.438345:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255552 00000100:00100000:0.0:1788927277.438352:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255552 00000100:00100000:0.0:1788927277.438395:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788927277.438404:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255552:12345-0@lo:503: 00000100:00100000:0.0:1788927277.438514:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255552:12345-0@lo:503: Request processed in 111us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.438521:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788927277.438809:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255552:0@lo:503: 00000040:00080000:2.0:1788927277.439171:0:8009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788927277.439239:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255680:0@lo:502: 00000100:00100000:2.0:1788927277.439282:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.439318:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788927277.439379:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255680 00000100:00100000:1.0:1788927277.439384:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255680 00000100:00100000:1.0:1788927277.439424:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788927277.439434:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255680:12345-0@lo:502: 00000100:00100000:1.0:1788927277.439525:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255680:12345-0@lo:502: Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927277.439531:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788927277.439746:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255680:0@lo:502: 00000040:00080000:2.0:1788927277.439931:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788927277.439961:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788927277.439976:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788927277.440001:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788927277.440017:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788927277.440030:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788927277.440044:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788927277.440057:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788927277.440068:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788927277.440080:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788927277.440106:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788927277.440119:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788927277.440130:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788927277.440142:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788927277.440154:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788927277.440167:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788927277.440180:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788927277.440193:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788927277.440207:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788927277.440218:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788927277.440230:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788927277.440241:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788927277.440251:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788927277.440262:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788927277.440274:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788927277.440286:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788927277.440308:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788927277.440323:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788927277.440336:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788927277.440348:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788927277.440361:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788927277.440373:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788927277.440386:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788927277.440399:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788927277.440421:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788927277.440435:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788927277.440447:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788927277.440469:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255808:0@lo:502: 00000100:00100000:2.0:1788927277.440508:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927277.440543:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927277.441047:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255808 00000100:00100000:3.0:1788927277.441054:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255808 00000100:00100000:3.0:1788927277.441102:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788927277.441112:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255808:12345-0@lo:502: 00000100:00100000:3.0:1788927277.441223:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075255808:12345-0@lo:502: Request processed in 113us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927277.441238:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788927277.441336:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075255808:0@lo:502: 00000040:00080000:2.0:1788927277.441380:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788927277.441388:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788927277.444072:0:8025:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788927277.444090:0:8025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff918843ae8000) 00000020:00000080:3.0:1788927277.444112:0:8025:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788927277.444209:0:8025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9188410d4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788927277.444214:0:8025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9188410d4800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788927277.444216:0:8025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9188410d4800 3 00010000:00080000:3.0:1788927277.444242:0:8025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff918843b17800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.154@tcp at head 00010000:00010000:3.0:1788927277.445801:0:8025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788927277.446048:0:8025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788927277.446091:0:8025:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788927277.446105:0:8025:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x750239bd504e9433 00000100:00080000:3.0:1788927277.446114:0:8025:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788927277.446119:0:8025:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff918843b17800 using connection 192.168.203.154@tcp/0@lo 00000100:00100000:3.0:1788927277.446155:0:8025:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff918945929f80 x1875826075255936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788927277.446188:0:8025:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788927277.448145:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927277.448168:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075256064:0@lo:400: 00000100:00100000:0.0:1788927277.448232:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927277.448280:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075256192:0@lo:400: 00000100:00100000:0.0:1788927277.448302:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927277.448322:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788927277.448328:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075256320:0@lo:400: 00000100:00100000:0.0:1788927277.448351:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927277.448383:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256064 00000100:00100000:0.0:1788927277.448389:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256064 00000100:00100000:0.0:1788927277.448429:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256192 00000100:00100000:0.0:1788927277.448432:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256192 00000100:00100000:0.0:1788927277.448457:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788927277.448465:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075256064:12345-0@lo:400: 00000100:00100000:0.0:1788927277.448514:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075256064:12345-0@lo:400: Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.448520:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788927277.448537:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788927277.448543:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075256192:12345-0@lo:400: 00000100:00100000:0.0:1788927277.448572:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075256192:12345-0@lo:400: Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.448577:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788927277.448624:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256320 00000100:00100000:0.0:1788927277.448628:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256320 00000100:00100000:0.0:1788927277.448658:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788927277.448665:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075256320:12345-0@lo:400: 00000100:00100000:0.0:1788927277.448694:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075256320:12345-0@lo:400: Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.448706:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788927277.448723:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3442:1875826075255936:0@lo:38: 00000100:00080000:0.0:1788927277.448725:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788927277.448729:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788927277.448754:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593c700 x1875826075256320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927277.448757:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927277.448768:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075256320:0@lo:400: 00010000:00080000:0.0:1788927277.448778:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593f800 x1875826075256192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927277.448786:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075256192:0@lo:400: 00000100:00100000:2.0:1788927277.448802:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075255936 00000100:00100000:2.0:1788927277.448805:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075255936 00010000:00080000:0.0:1788927277.448814:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593f100 x1875826075256064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927277.448823:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075256064:0@lo:400: 00000100:00100000:2.0:1788927277.448835:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788927277.448839:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3442:x1875826075255936:12345-0@lo:38: 00010000:00080000:2.0:1788927277.448859:0:5954:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:2.0:1788927277.448890:0:5954:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x750239bd504e943a 00000004:00100000:2.0:1788927277.448903:0:5954:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788927277.448943:0:5954:0:(import.c:65:import_set_state_nolock()) ffff918843919000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788927277.449001:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3442:x1875826075255936:12345-0@lo:38: Request processed in 160us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927277.449007:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1788927277.454296:0:8025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1788927277.454468:0:8027:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff91894592a680 x1875826075256448/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927277.454480:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2ce40 going to sleep for 0 seconds 00010000:00080000:0.0:1788927277.454578:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff918945929f80 x1875826075255936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788927287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927277.454588:0:3442:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788927277.454613:0:3442:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788927277.454621:0:3442:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000000:2.0:1788927277.454626:0:8009:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00080000:0.0:1788927277.454626:0:3442:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788927277.454630:0:3442:0:(import.c:65:import_set_state_nolock()) ffff918843b17800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788927277.454636:0:3442:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f1c3fcc6): req@ffff91894592a680 x1875826075256448/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927277.454648:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3442:1875826075255936:0@lo:38: 10000000:01000000:2.0:1788927277.454655:0:8009:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788927277.454674:0:8009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.454694:0:8009:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788927277.454751:0:8009:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788927277.454753:0:8009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788927277.454755:0:8009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927277.454756:0:8009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927277.454757:0:8009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927277.454759:0:8009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927277.454760:0:8009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788927277.454762:0:8009:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927277.454764:0:8009:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927277.454766:0:8009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927277.454767:0:8009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788927277.454771:0:8009:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788927277.454773:0:8009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788927277.454775:0:8009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788927277.454776:0:8009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788927277.454777:0:8009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788927277.454778:0:8009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788927277.454779:0:8009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788927277.454780:0:8009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788927277.454781:0:8009:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788927277.454782:0:8009:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788927277.454783:0:8009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788927277.454784:0:8009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788927277.454799:0:8009:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788927277.454808:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075256576:0@lo:253: 00000100:00100000:2.0:1788927277.454882:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927277.455137:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256576 00000100:00100000:2.0:1788927277.455139:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.455143:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256576 00000100:00100000:0.0:1788927277.455199:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788927277.455209:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075256576:12345-0@lo:253: 20000000:01000000:0.0:1788927277.455234:0:5947:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788927277.455247:0:5947:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788927277.459429:0:8027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927277.459468:0:8027:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788927277.459530:0:5965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256448 00000100:00100000:0.0:1788927277.459538:0:5965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256448 00000100:00100000:0.0:1788927277.459632:0:5965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788927277.459642:0:5965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8027:x1875826075256448:12345-0@lo:901: 00000100:00080000:2.0:1788927277.459990:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927277.460117:0:5965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8027:x1875826075256448:12345-0@lo:901: Request processed in 475us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.460125:0:5965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:0.0:1788927277.467470:0:5947:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788927277.467492:0:5947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788927277.467784:0:5970:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788927277.467858:0:5970:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788927277.467879:0:5970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.467977:0:5970:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.467993:0:5970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.468032:0:5970:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.468046:0:5970:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927277.468060:0:5970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5970:1875826075256704:0@lo:104: 00000100:00100000:1.0:1788927277.468280:0:5970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927277.468431:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:8009:x1875826075256576:12345-0@lo:253: Request processed in 13222us (13548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927277.468440:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788927277.468768:0:5970:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52f00 going to sleep for 11 seconds 00010000:00080000:3.0:1788927277.469054:0:8027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894592a680 x1875826075256448/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788927293 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927277.469081:0:8027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592a680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:8027:1875826075256448:0@lo:901: 00000100:00100000:3.0:1788927277.470210:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3b70cda-d4d0-488a-a813-7f141061abda:8009:1875826075256576:0@lo:253: 10000000:01000000:3.0:1788927277.470239:0:8009:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788927277.470242:0:8009:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788927277.470244:0:8009:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788927277.470245:0:8009:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788927277.470247:0:8009:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788927277.470248:0:8009:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788927277.470249:0:8009:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788927277.470251:0:8009:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788927277.470253:0:8009:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788927277.470254:0:8009:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788927277.470256:0:8009:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788927277.470257:0:8009:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788927277.470273:0:8009:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788927277.473534:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256704 00000100:00100000:2.0:1788927277.473549:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256704 00000100:00100000:2.0:1788927277.473634:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788927277.473646:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5970:x1875826075256704:12345-0@lo:104: 00010000:00010000:2.0:1788927277.473665:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.474323:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788927277.474330:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:5970:x1875826075256704:12345-0@lo:104: Request processed in 687us (6051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927277.474337:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788927277.474397:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788927277.474405:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.474413:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779400 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:0.0:1788927277.474417:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.474425:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788927277.474432:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927277.474449:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788927277.474492:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.474499:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788927277.474518:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.474525:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e938b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9392 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927277.474542:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927277.474544:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927277.474545:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927277.474560:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075256832:0@lo:103: 00000100:00100000:0.0:1788927277.474623:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.474734:0:5970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5970:1875826075256704:0@lo:104: 00010000:00010000:1.0:1788927277.474756:0:5970:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.474926:0:8019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256832 00000100:00100000:2.0:1788927277.474931:0:8019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256832 00010000:00010000:2.0:1788927277.474950:0:8019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927277.475024:0:8019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788927277.475032:0:8019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918950fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b70cda-d4d0-488a-a813-7f141061abda+14:3443:x1875826075256832:12345-0@lo:103: 00010000:00010000:2.0:1788927277.475043:0:8019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927277.475048:0:8019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475058:0:8019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475072:0:8019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820dfa00/0x750239bd504e9392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e938b expref: 14 pid: 5948 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475084:0:8019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475092:0:8019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788927277.475105:0:8019:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008062681s 00010000:00010000:2.0:1788927277.475110:0:8019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475124:0:8019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475132:0:8019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475138:0:8019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475144:0:8019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951778a00 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:2.0:1788927277.475148:0:8019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475155:0:8019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475175:0:8019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927277.475184:0:8019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927277.475218:0:8019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918950fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b70cda-d4d0-488a-a813-7f141061abda+13:3443:x1875826075256832:12345-0@lo:103: Request processed in 187us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927277.475225:0:8019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788927277.475261:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075256832:0@lo:103: 00010000:00010000:1.0:1788927277.475313:0:5970:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.475321:0:5970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927277.475328:0:5970:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951778a00/0x750239bd504e9441 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788927277.477396:0:8009:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788927277.477588:0:8009:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788927277.477815:0:8009:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788927277.477964:0:8009:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788927277.478170:0:8009:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788927277.478385:0:8009:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788927277.479461:0:8009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788927277.502326:0:8009:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788927277.502337:0:8009:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788927277.502382:0:8009:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788927277.502428:0:8009:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788927277.502447:0:8009:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788927277.502466:0:8009:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788927277.503532:0:8009:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788927277.509463:0:8009:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788927277.659360:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075256960:0@lo:13: 00000100:00100000:3.0:1788927277.659429:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927277.659536:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075256960 00000100:00100000:1.0:1788927277.659544:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075256960 00000100:00100000:1.0:1788927277.659618:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788927277.659628:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075256960:12345-0@lo:13: 00002000:00000024:1.0:1788927277.659655:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927277.659712:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075256960:12345-0@lo:13: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927277.659719:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788927277.659864:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91894593f100 x1875826075256960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927277.659881:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075256960:0@lo:13: 00010000:00010000:3.0:1788927277.979380:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788927278.586482:0:8080:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788927278.586936:0:8080:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788927279.004680:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927280.026880:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927281.054729:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927282.091019:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927282.783547:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075257088:0@lo:13: 00000100:00100000:2.0:1788927282.783641:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927282.783823:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257088 00000100:00100000:2.0:1788927282.783832:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257088 00000100:00100000:2.0:1788927282.783887:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788927282.783910:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075257088:12345-0@lo:13: 00002000:00000024:2.0:1788927282.783940:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927282.783999:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075257088:12345-0@lo:13: Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927282.784006:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788927282.784026:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788927282.784053:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967460a80 x1875826075257088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927282.784072:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075257088:0@lo:13: 00000100:00100000:3.0:1788927282.785618:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075257216:0@lo:400: 00000100:00100000:3.0:1788927282.785673:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927282.786542:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075257344:0@lo:400: 00000100:00100000:3.0:1788927282.786650:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788927282.786659:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075257600:0@lo:400: 00000100:00100000:2.0:1788927282.788936:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075257472:0@lo:400: 00000100:00100000:0.0:1788927282.795843:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927282.795914:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257344 00000100:00100000:0.0:1788927282.795923:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257344 00000100:00100000:0.0:1788927282.795993:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788927282.796004:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075257344:12345-0@lo:400: 00000100:00100000:0.0:1788927282.796060:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075257344:12345-0@lo:400: Request processed in 58us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927282.796067:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788927282.796127:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894592b480 x1875826075257344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927282.796140:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075257344:0@lo:400: 00000100:00100000:3.0:1788927282.797033:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927282.797076:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257216 00000100:00100000:3.0:1788927282.797081:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257216 00000100:00100000:3.0:1788927282.797226:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788927282.797237:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:3446:x1875826075257216:12345-0@lo:400: 00000100:00100000:3.0:1788927282.797279:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:3446:x1875826075257216:12345-0@lo:400: Request processed in 44us (11605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927282.797294:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788927282.797324:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257600 00000100:00100000:3.0:1788927282.797328:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257600 00000100:00100000:3.0:1788927282.797360:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788927282.797366:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075257600:12345-0@lo:400: 00000100:00100000:3.0:1788927282.797396:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075257600:12345-0@lo:400: Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927282.797402:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788927282.797420:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788927282.797671:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918945928380 x1875826075257600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927282.797683:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075257600:0@lo:400: 00000100:00100000:3.0:1788927282.797904:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075257216:0@lo:400: 00000100:00100000:2.0:1788927282.799588:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927282.800823:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257472 00000100:00100000:0.0:1788927282.800835:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257472 00000100:00100000:0.0:1788927282.800923:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788927282.800934:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075257472:12345-0@lo:400: 00000100:00100000:0.0:1788927282.801017:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075257472:12345-0@lo:400: Request processed in 86us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927282.801024:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788927282.801124:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788927282.801389:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894592aa00 x1875826075257472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927282.801839:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075257472:0@lo:400: 00010000:00010000:0.0:1788927283.099645:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788927283.291872:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788927283.291879:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff918974bed000 from 30 10000000:01000000:2.0:1788927283.291883:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788927283.291927:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.291938:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.291961:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927283.291987:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075257728:0@lo:101: 00000100:00100000:2.0:1788927283.292067:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.292121:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257728 00000100:00100000:3.0:1788927283.292128:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257728 00000100:00100000:2.0:1788927283.292128:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482840 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.292174:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788927283.292184:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075257728:12345-0@lo:101: 00010000:00010000:3.0:1788927283.292196:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927283.292209:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9448 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.292232:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9448 expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.292242:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9448 expref: 14 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.292267:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df000, rc 0) 00000100:00100000:3.0:1788927283.292318:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075257728:12345-0@lo:101: Request processed in 135us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.292325:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788927283.292417:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075257728:0@lo:101: 00010000:00010000:2.0:1788927283.292441:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.292458:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927283.292511:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075257856:0@lo:501: 00000100:00100000:2.0:1788927283.292537:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927283.292558:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482840 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.292662:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257856 00000100:00100000:3.0:1788927283.292666:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257856 00000100:00100000:3.0:1788927283.292699:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788927283.292706:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075257856:12345-0@lo:501: 00000100:00100000:3.0:1788927283.292825:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075257856:12345-0@lo:501: Request processed in 119us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.292832:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788927283.292863:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075257856:0@lo:501: 00000100:00100000:3.0:1788927283.292885:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075257984:0@lo:503: 00000100:00100000:3.0:1788927283.292922:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.292940:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dcf7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.292963:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075257984 00000100:00100000:3.0:1788927283.292967:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075257984 00000100:00100000:3.0:1788927283.292983:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788927283.292989:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075257984:12345-0@lo:503: 00000100:00100000:3.0:1788927283.293060:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075257984:12345-0@lo:503: Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.293067:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788927283.293101:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075257984:0@lo:503: 00000100:00100000:3.0:1788927283.293253:0:8304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8304:1875826075258112:0@lo:502: 00000100:00100000:3.0:1788927283.293286:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.293302:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258112 00000100:00100000:3.0:1788927283.293305:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258112 00000100:00100000:3.0:1788927283.293321:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788927283.293326:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8304:x1875826075258112:12345-0@lo:502: 00000100:00100000:3.0:1788927283.293389:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8304:x1875826075258112:12345-0@lo:502: Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.293396:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788927283.293422:0:8304:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.293544:0:8304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8304:1875826075258112:0@lo:502: 00000100:00100000:3.0:1788927283.293580:0:8304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8304:1875826075258240:0@lo:502: 00000100:00100000:3.0:1788927283.293633:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.293651:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258240 00000100:00100000:3.0:1788927283.293654:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258240 00000100:00100000:3.0:1788927283.293669:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788927283.293674:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8304:x1875826075258240:12345-0@lo:502: 00000100:00100000:3.0:1788927283.295248:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8304:x1875826075258240:12345-0@lo:502: Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.295265:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788927283.295321:0:8304:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.295340:0:8304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8304:1875826075258240:0@lo:502: 00000040:00080000:3.0:1788927283.295369:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788927283.297754:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788927283.297794:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788927283.297805:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.297817:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927283.297826:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788927283.297828:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788927283.297831:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788927283.297869:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.297877:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.297887:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927283.297909:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075258368:0@lo:101: 00000100:00100000:2.0:1788927283.297982:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927283.298035:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482840 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.298056:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258368 00000100:00100000:3.0:1788927283.298063:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258368 00000100:00100000:3.0:1788927283.298114:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788927283.298123:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075258368:12345-0@lo:101: 00010000:00010000:3.0:1788927283.298144:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927283.298156:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9456 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.298180:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9456 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.298190:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9456 expref: 15 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.298199:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de600, rc 0) 00000100:00100000:3.0:1788927283.299676:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075258368:12345-0@lo:101: Request processed in 1549us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.299687:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788927283.300560:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075258368:0@lo:101: 00010000:00010000:2.0:1788927283.300583:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927283.300816:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927283.300893:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075258496:0@lo:501: 00000100:00100000:2.0:1788927283.300941:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927283.301024:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482840 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.301281:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258496 00000100:00100000:3.0:1788927283.301288:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258496 00000100:00100000:3.0:1788927283.301331:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788927283.301341:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075258496:12345-0@lo:501: 00000100:00100000:3.0:1788927283.302054:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075258496:12345-0@lo:501: Request processed in 712us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.302062:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788927283.302408:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075258496:0@lo:501: 00000100:00100000:2.0:1788927283.302540:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075258624:0@lo:503: 00000100:00100000:2.0:1788927283.302585:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927283.302681:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482840 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.302724:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258624 00000100:00100000:3.0:1788927283.302730:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258624 00000100:00100000:3.0:1788927283.302930:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788927283.302941:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075258624:12345-0@lo:503: 00000100:00100000:3.0:1788927283.303229:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075258624:12345-0@lo:503: Request processed in 290us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.303237:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788927283.303325:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075258624:0@lo:503: 00000100:00100000:2.0:1788927283.304024:0:8305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8305:1875826075258752:0@lo:502: 00000100:00100000:2.0:1788927283.304075:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927283.304142:0:8305:0:(client.c:2715:ptlrpc_set_wait()) set ffff918967482840 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.304241:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258752 00000100:00100000:3.0:1788927283.304246:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258752 00000100:00100000:3.0:1788927283.304272:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788927283.304279:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:8305:x1875826075258752:12345-0@lo:502: 00000100:00100000:3.0:1788927283.304357:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:8305:x1875826075258752:12345-0@lo:502: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.304365:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788927283.307757:0:8305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8305:1875826075258752:0@lo:502: 00000020:01000000:2.0:1788927283.307800:0:8305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788927283.307812:0:8305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788927283.307814:0:8305:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788927283.307820:0:8305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788927283.307822:0:8305:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788927283.307853:0:8305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8305:1875826075258880:0@lo:502: 00000100:00100000:2.0:1788927283.307927:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927283.307998:0:8305:0:(client.c:2715:ptlrpc_set_wait()) set ffff918943721b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.308317:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075258880 00000100:00100000:0.0:1788927283.308325:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075258880 00000100:00100000:0.0:1788927283.308467:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788927283.308476:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:8305:x1875826075258880:12345-0@lo:502: 00000100:00100000:0.0:1788927283.308618:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:8305:x1875826075258880:12345-0@lo:502: Request processed in 142us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.308625:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788927283.308701:0:8305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8305:1875826075258880:0@lo:502: 00000020:01000000:2.0:1788927283.308720:0:8305:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788927283.308724:0:8305:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788927283.308726:0:8305:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788927283.308729:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788927283.308989:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788927283.309009:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788927283.309019:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309029:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927283.309055:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788927283.309058:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91895033f000 from 30 10000000:01000000:1.0:1788927283.309060:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788927283.309086:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309094:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309103:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927283.309117:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259008:0@lo:101: 00000100:00100000:1.0:1788927283.309147:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.309170:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9189482a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.309184:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259008 00000100:00100000:1.0:1788927283.309188:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259008 00000100:00100000:1.0:1788927283.309214:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788927283.309221:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075259008:12345-0@lo:101: 00010000:00010000:1.0:1788927283.309230:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927283.309242:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9464 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309264:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9464 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309274:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9464 expref: 16 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309292:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951779200, rc 0) 00000100:00100000:1.0:1788927283.309323:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075259008:12345-0@lo:101: Request processed in 103us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.309329:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788927283.309378:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259008:0@lo:101: 00010000:00010000:1.0:1788927283.309392:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.309401:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927283.309449:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259136:0@lo:501: 00000100:00100000:1.0:1788927283.309472:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.309485:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9189603550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.309496:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259136 00000100:00100000:1.0:1788927283.309499:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259136 00000100:00100000:1.0:1788927283.309521:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788927283.309526:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075259136:12345-0@lo:501: 00000100:00100000:1.0:1788927283.309635:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075259136:12345-0@lo:501: Request processed in 107us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.309641:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788927283.309671:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259136:0@lo:501: 00000100:00100000:1.0:1788927283.309884:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259264:0@lo:503: 00000100:00100000:1.0:1788927283.309923:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.309937:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9189603550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.309966:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259264 00000100:00100000:1.0:1788927283.309970:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259264 00000100:00100000:1.0:1788927283.309992:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788927283.309997:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075259264:12345-0@lo:503: 00000100:00100000:1.0:1788927283.310074:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075259264:12345-0@lo:503: Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.310080:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788927283.310119:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259264:0@lo:503: 00000100:00100000:1.0:1788927283.310266:0:8307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8307:1875826075259392:0@lo:502: 00000100:00100000:1.0:1788927283.310295:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.310311:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259392 00000100:00100000:1.0:1788927283.310314:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259392 00000100:00100000:1.0:1788927283.310331:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788927283.310336:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:8307:x1875826075259392:12345-0@lo:502: 00000100:00100000:1.0:1788927283.310501:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:8307:x1875826075259392:12345-0@lo:502: Request processed in 163us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.310507:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788927283.310537:0:8307:0:(client.c:2715:ptlrpc_set_wait()) set ffff9189482a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.310548:0:8307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8307:1875826075259392:0@lo:502: 00000100:00100000:1.0:1788927283.310580:0:8307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8307:1875826075259520:0@lo:502: 00000100:00100000:1.0:1788927283.310624:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.310640:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259520 00000100:00100000:1.0:1788927283.310643:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259520 00000100:00100000:1.0:1788927283.310664:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788927283.310670:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:8307:x1875826075259520:12345-0@lo:502: 00000100:00100000:1.0:1788927283.310796:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:8307:x1875826075259520:12345-0@lo:502: Request processed in 125us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.310806:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788927283.310831:0:8307:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897c875b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.310841:0:8307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8307:1875826075259520:0@lo:502: 00000040:00080000:1.0:1788927283.310856:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788927283.310898:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788927283.310915:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788927283.310920:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.310929:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927283.310938:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788927283.310940:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91895033f000 from 5 10000000:01000000:1.0:1788927283.310954:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788927283.310976:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.310984:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.310992:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927283.311002:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259648:0@lo:101: 00000100:00100000:1.0:1788927283.311027:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.311041:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897c875b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.311136:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259648 00000100:00100000:0.0:1788927283.311140:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259648 00000100:00100000:0.0:1788927283.311164:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788927283.311171:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075259648:12345-0@lo:101: 00010000:00010000:0.0:1788927283.311179:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927283.311196:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc0a00/0x750239bd504e9479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9472 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927283.311213:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0a00/0x750239bd504e9479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9472 expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927283.311223:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc0a00/0x750239bd504e9479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9472 expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927283.311230:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0a00, rc 0) 00000100:00100000:0.0:1788927283.311256:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075259648:12345-0@lo:101: Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.311261:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788927283.311371:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259648:0@lo:101: 00010000:00010000:1.0:1788927283.311390:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9479 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.311398:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9479 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927283.311437:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259776:0@lo:256: 00000100:00100000:1.0:1788927283.311466:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.311497:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897c875b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.311511:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259776 00000100:00100000:1.0:1788927283.311514:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259776 00000100:00100000:1.0:1788927283.311534:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788927283.311539:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075259776:12345-0@lo:256: 20000000:01000000:1.0:1788927283.311550:0:5949:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788927283.311565:0:5949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788927283.311567:0:5949:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788927283.311666:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075259776:12345-0@lo:256: Request processed in 126us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.311673:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788927283.311774:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259776:0@lo:256: 10000000:01000000:1.0:1788927283.311808:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788927283.311813:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9479 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.311819:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951779000/0x750239bd504e9472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9479 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927283.311826:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788927283.311832:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788927283.311834:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788927283.311848:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.311854:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.311860:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927283.311872:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259904:0@lo:101: 00000100:00100000:1.0:1788927283.311896:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.312008:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897c875b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.312020:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075259904 00000100:00100000:1.0:1788927283.312023:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075259904 00000100:00100000:1.0:1788927283.312115:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788927283.312123:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075259904:12345-0@lo:101: 00010000:00010000:1.0:1788927283.312130:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927283.312138:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9480 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.312151:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9480 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.312159:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9480 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.312165:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951778a00, rc 0) 00000100:00100000:1.0:1788927283.312193:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075259904:12345-0@lo:101: Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.312203:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788927283.312233:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075259904:0@lo:101: 00010000:00010000:1.0:1788927283.312243:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927283.312250:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927283.312291:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075260032:0@lo:501: 00000100:00100000:1.0:1788927283.312314:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.312326:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897c875b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788927283.312335:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260032 00000100:00100000:1.0:1788927283.312338:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260032 00000100:00100000:1.0:1788927283.312533:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788927283.312542:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075260032:12345-0@lo:501: 00000100:00100000:1.0:1788927283.312646:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075260032:12345-0@lo:501: Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.312653:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788927283.312680:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075260032:0@lo:501: 00000100:00100000:1.0:1788927283.313939:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075260160:0@lo:503: 00000100:00100000:1.0:1788927283.315499:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.315546:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897c875b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.315698:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260160 00000100:00100000:0.0:1788927283.315706:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260160 00000100:00100000:0.0:1788927283.315749:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788927283.315759:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075260160:12345-0@lo:503: 00000100:00100000:0.0:1788927283.315871:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075260160:12345-0@lo:503: Request processed in 112us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.315879:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788927283.315930:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075260160:0@lo:503: 00000100:00100000:0.0:1788927283.316229:0:8309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967462d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8309:1875826075260288:0@lo:502: 00000100:00100000:0.0:1788927283.316264:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927283.316285:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260288 00000100:00100000:0.0:1788927283.316289:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260288 00000100:00100000:0.0:1788927283.316309:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788927283.316315:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+18:8309:x1875826075260288:12345-0@lo:502: 00000100:00100000:0.0:1788927283.316407:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+18:8309:x1875826075260288:12345-0@lo:502: Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.316420:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788927283.316453:0:8309:0:(client.c:2715:ptlrpc_set_wait()) set ffff9189496180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.316465:0:8309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967462d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8309:1875826075260288:0@lo:502: 00000020:01000000:0.0:1788927283.316486:0:8309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788927283.316493:0:8309:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788927283.316500:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927283.316502:0:8309:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788927283.316506:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788927283.316510:0:8309:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.154@tcp to nid 0x20000c0a8cb9a (192.168.203.154@tcp) 00000020:01000000:0.0:1788927283.316530:0:8309:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788927283.316532:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788927283.316547:0:8309:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9188444919b8) 00000020:00000080:0.0:1788927283.316565:0:8309:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788927283.316570:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788927283.316657:0:8309:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788927283.316662:0:8309:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788927283.316669:0:8309:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x750239bd504e9495 00010000:00080000:0.0:1788927283.316709:0:8309:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91896985f800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.154@tcp at head 00010000:00010000:0.0:1788927283.316917:0:8309:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788927283.317042:0:8309:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788927283.318159:0:8309:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788927283.318340:0:8309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927283.318954:0:8309:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788927283.319757:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788927283.319865:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788927283.324536:0:8310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788927283.324544:0:8310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788927283.334260:0:8309:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788927283.334276:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788927283.334318:0:8309:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788927283.334338:0:8309:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x750239bd504e949c 00000100:00080000:3.0:1788927283.334347:0:8309:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788927283.334364:0:8309:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91896985f800 using connection 192.168.203.154@tcp/0@lo 00000100:00100000:3.0:1788927283.334401:0:8309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff918945928a80 x1875826075260416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788927283.334428:0:8309:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788927283.334486:0:8309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788927283.334491:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927283.334493:0:8309:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788927283.334496:0:8309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788927283.334500:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927283.334502:0:8309:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788927283.334504:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788927283.334506:0:8309:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788927283.334533:0:8309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8309:1875826075260544:0@lo:502: 00000100:00100000:3.0:1788927283.334635:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.334669:0:8309:0:(client.c:2715:ptlrpc_set_wait()) set ffff91894906e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.334792:0:3442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1875826075260416:0@lo:8: 00000100:00100000:0.0:1788927283.334838:0:3442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927283.334880:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260544 00000100:00100000:0.0:1788927283.334887:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260544 00000100:00100000:0.0:1788927283.334933:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788927283.334953:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+18:8309:x1875826075260544:12345-0@lo:502: 00000100:00100000:1.0:1788927283.335160:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075260672:0@lo:400: 00000100:00100000:1.0:1788927283.335192:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.335215:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788927283.335228:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075261056:0@lo:400: 00000100:00100000:1.0:1788927283.335263:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.335292:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075260800:0@lo:400: 00000100:00100000:1.0:1788927283.335314:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.335332:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788927283.335337:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075260928:0@lo:400: 00000100:00100000:1.0:1788927283.335357:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927283.335385:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260672 00000100:00100000:1.0:1788927283.335389:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260672 00000100:00100000:1.0:1788927283.335409:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261056 00000100:00100000:1.0:1788927283.335411:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261056 00000100:00100000:1.0:1788927283.335422:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260800 00000100:00100000:1.0:1788927283.335424:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260800 00000100:00100000:1.0:1788927283.335436:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788927283.335442:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075260672:12345-0@lo:400: 00000100:00100000:1.0:1788927283.335480:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075260672:12345-0@lo:400: Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.335487:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788927283.335501:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788927283.335508:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075261056:12345-0@lo:400: 00000100:00100000:1.0:1788927283.335534:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075261056:12345-0@lo:400: Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.335540:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788927283.335551:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788927283.335557:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075260800:12345-0@lo:400: 00000100:00100000:1.0:1788927283.335586:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075260800:12345-0@lo:400: Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.335620:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788927283.335646:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260416 00000100:00100000:1.0:1788927283.335649:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260416 00000100:00100000:1.0:1788927283.335666:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075260928 00000100:00100000:1.0:1788927283.335668:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075260928 00000100:00100000:1.0:1788927283.335682:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927283.335703:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075260928:12345-0@lo:400: 00000100:00100000:1.0:1788927283.335732:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075260928:12345-0@lo:400: Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.335737:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788927283.335747:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788927283.335751:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3442:x1875826075260416:12345-0@lo:8: 00010000:00080000:1.0:1788927283.335770:0:6941:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788927283.335792:0:6941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x750239bd504e94a3 00002000:00100000:1.0:1788927283.335805:0:6941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff918842fa0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113938 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788927283.335808:0:6941:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788927283.335812:0:6941:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788927283.335866:0:6941:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788927283.336092:0:6941:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788927283.336113:0:6941:0:(import.c:65:import_set_state_nolock()) ffff918842fa3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788927283.336154:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3442:x1875826075260416:12345-0@lo:8: Request processed in 400us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.336161:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788927283.336197:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593ce00 x1875826075260928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927283.336209:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075260928:0@lo:400: 00010000:00080000:1.0:1788927283.336232:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593ea00 x1875826075260800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927283.336240:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075260800:0@lo:400: 00010000:00080000:1.0:1788927283.336274:0:3442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918945928a80 x1875826075260416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788927293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927283.336281:0:3442:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788927283.336287:0:3442:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788927283.336294:0:3442:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788927283.336298:0:3442:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788927283.336300:0:3442:0:(import.c:65:import_set_state_nolock()) ffff91896985f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788927283.336309:0:3442:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788927283.336313:0:3442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3442:1875826075260416:0@lo:8: 00010000:00080000:1.0:1788927283.336336:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593c700 x1875826075261056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927283.336345:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075261056:0@lo:400: 00010000:00080000:1.0:1788927283.336353:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593d880 x1875826075260672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927283.336361:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075260672:0@lo:400: 00000004:00080000:1.0:1788927283.336378:0:8310:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788927283.336422:0:8310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 232460825474ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788927283.336429:0:8310:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788927283.341983:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+18:8309:x1875826075260544:12345-0@lo:502: Request processed in 7032us (7338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.341999:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788927283.345485:0:8309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8309:1875826075260544:0@lo:502: 00000020:01000000:3.0:1788927283.345532:0:8309:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788927283.345540:0:8309:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788927283.345542:0:8309:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788927283.345546:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788927283.345638:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788927283.345660:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788927283.345671:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.345682:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927283.345762:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788927283.345765:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9189491499b8 from 1 10000000:01000000:3.0:1788927283.345767:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788927283.345798:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.345807:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.345815:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927283.345834:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075261184:0@lo:101: 00000100:00100000:3.0:1788927283.345889:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.345923:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897e14c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.345940:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261184 00000100:00100000:3.0:1788927283.345957:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261184 00000100:00100000:3.0:1788927283.346008:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788927283.346018:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075261184:12345-0@lo:101: 00010000:00010000:3.0:1788927283.346029:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927283.346975:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e94aa expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.347000:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e94aa expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.347015:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e94aa expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.347024:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de200, rc 0) 00000004:00080000:2.0:1788927283.350170:0:5933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788927283.350209:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075261184:12345-0@lo:101: Request processed in 4186us (4313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927283.350221:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788927283.350752:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075261184:0@lo:101: 00010000:00010000:0.0:1788927283.350778:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927283.350792:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927283.350876:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075261312:0@lo:501: 00000100:00100000:0.0:1788927283.350925:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927283.350968:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918949618b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.350985:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261312 00000100:00100000:0.0:1788927283.350991:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261312 00000100:00100000:0.0:1788927283.351086:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788927283.351098:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075261312:12345-0@lo:501: 00000100:00100000:0.0:1788927283.351185:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075261312:12345-0@lo:501: Request processed in 90us (259us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927283.351192:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788927283.351437:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967462a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075261312:0@lo:501: 10000000:01000000:3.0:1788927283.351466:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788927283.351473:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927283.351482:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927283.352384:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788927283.352396:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075261440:0@lo:13: 00000100:00100000:0.0:1788927283.352432:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788927283.352457:0:8311:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788927283.352474:0:8311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075261568:0@lo:7: 00000100:00100000:0.0:1788927283.352509:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927283.352534:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261568 00000100:00100000:0.0:1788927283.352539:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261568 00000100:00100000:0.0:1788927283.352580:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788927283.352589:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8311:x1875826075261568:12345-0@lo:7: 00000100:00100000:2.0:1788927283.352990:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261440 00000100:00100000:2.0:1788927283.352995:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261440 00000100:00100000:2.0:1788927283.353022:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788927283.353029:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1875826075261440:12345-0@lo:13: 00002000:00000024:2.0:1788927283.353098:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1788927283.353150:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3445:x1875826075261440:12345-0@lo:13: Request processed in 121us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927283.353156:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788927283.353275:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967462a00 x1875826075261440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927283.353295:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075261440:0@lo:13: 00000100:00080000:2.0:1788927283.354865:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788927283.358886:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788927283.358893:0:6941:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788927283.358989:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8311:x1875826075261568:12345-0@lo:7: Request processed in 6397us (6475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.359000:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788927283.360730:0:8311:0:(client.c:2715:ptlrpc_set_wait()) set ffff918949618d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788927283.360772:0:8311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967463b80 x1875826075261568/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788927299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927283.360786:0:8311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075261568:0@lo:7: 00000004:00080000:0.0:1788927283.360800:0:8311:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788927283.360844:0:8311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075261696:0@lo:5: 00000100:00100000:0.0:1788927283.360889:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927283.360930:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261696 00000100:00100000:0.0:1788927283.360936:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261696 00000100:00100000:0.0:1788927283.360993:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788927283.361002:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8311:x1875826075261696:12345-0@lo:5: 00002000:00080000:0.0:1788927283.361028:0:6943:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788927283.361733:0:6943:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788927283.375772:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788927283.375791:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788927283.376008:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8311:x1875826075261696:12345-0@lo:5: Request processed in 15002us (15113us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788927283.376018:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788927283.376153:0:8311:0:(client.c:2715:ptlrpc_set_wait()) set ffff918949618d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788927283.376186:0:8311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967463b80 x1875826075261696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788927299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927283.376197:0:8311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788927283.376203:0:8311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075261696:0@lo:5: 00000004:00080000:0.0:1788927283.376216:0:8311:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788927283.376261:0:8311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075261824:0@lo:700: 00000100:00100000:0.0:1788927283.376294:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927283.376362:0:8311:0:(client.c:2715:ptlrpc_set_wait()) set ffff918949618d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.383829:0:6949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261824 00000100:00100000:3.0:1788927283.383844:0:6949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261824 00000100:00100000:3.0:1788927283.383922:0:6949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788927283.383961:0:6949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8311:x1875826075261824:12345-0@lo:700: 00000100:00100000:3.0:1788927283.384022:0:6949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6949:1875826075261952:0@lo:700: 00000100:00100000:3.0:1788927283.384084:0:6949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.384125:0:6949:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897e14c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788927283.384147:0:5961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075261952 00000100:00100000:3.0:1788927283.384150:0:5961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075261952 00000100:00100000:3.0:1788927283.384177:0:5961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788927283.384183:0:5961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6949:x1875826075261952:12345-0@lo:700: 40000000:02000000:3.0:1788927283.395108:0:5961:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788927283.411416:0:5961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6949:x1875826075261952:12345-0@lo:700: Request processed in 27223us (27322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927283.411436:0:5961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788927283.411495:0:6949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918945928380 x1875826075261952/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788927299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927283.411511:0:6949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945928380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6949:1875826075261952:0@lo:700: 40000000:02000000:0.0:1788927283.411524:0:6949:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788927283.451853:0:6949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8311:x1875826075261824:12345-0@lo:700: Request processed in 67900us (75549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927283.451868:0:6949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788927283.451888:0:8311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967463b80 x1875826075261824/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788927299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927283.451903:0:8311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075261824:0@lo:700: 00000004:02000040:3.0:1788927283.461831:0:8311:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788927283.470720:0:8311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075262080:0@lo:5: 00000100:00100000:3.0:1788927283.470795:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927283.470857:0:8311:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897e14c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788927283.470989:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262080 00000100:00100000:0.0:1788927283.470997:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262080 00000100:00100000:0.0:1788927283.471070:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788927283.471080:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8311:x1875826075262080:12345-0@lo:5: 00002000:00080000:3.0:1788927283.482229:0:6941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788927283.482246:0:6941:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788927283.489131:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8311:x1875826075262080:12345-0@lo:5: Request processed in 18042us (18325us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788927283.489157:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788927283.489316:0:8311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894592aa00 x1875826075262080/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788927299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927283.489347:0:8311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894592aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8311:1875826075262080:0@lo:5: 00000004:00080000:0.0:1788927283.489362:0:8311:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788927284.127738:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788927284.684558:0:8375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788927285.150872:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788927285.767833:0:8428:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788927285.768005:0:8428:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788927286.174833:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788927286.907728:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788927287.194803:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927287.900352:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927287.902002:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075262208:0@lo:13: 00000100:00100000:2.0:1788927287.902082:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927287.902690:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262208 00000100:00100000:0.0:1788927287.902701:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262208 00000100:00080000:2.0:1788927287.902936:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788927287.902944:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788927287.902955:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075262208:12345-0@lo:13: 00002000:00000024:0.0:1788927287.902988:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927287.903056:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075262208:12345-0@lo:13: Request processed in 102us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927287.903062:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788927287.903148:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967463b80 x1875826075262208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927287.903167:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075262208:0@lo:13: 00010000:00010000:2.0:1788927288.221368:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927288.412007:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927288.412035:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918967461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075262464:0@lo:13: 00000100:00100000:3.0:1788927288.412107:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927288.412222:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262464 00000100:00100000:0.0:1788927288.412229:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262464 00000100:00100000:0.0:1788927288.412290:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788927288.412300:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075262464:12345-0@lo:13: 00002000:00000024:0.0:1788927288.412329:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927288.412375:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075262464:12345-0@lo:13: Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927288.412393:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788927288.412632:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788927288.412672:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918967461500 x1875826075262464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927288.412682:0:3443:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788927288.412701:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918967461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075262464:0@lo:13: 00000100:00100000:2.0:1788927288.414862:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075262848:0@lo:400: 00000100:00100000:2.0:1788927288.414939:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927288.414980:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927288.414987:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075262720:0@lo:400: 00000100:00100000:2.0:1788927288.415010:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927288.415190:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075262592:0@lo:400: 00000100:00100000:3.0:1788927288.415221:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927288.415253:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788927288.415260:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075262336:0@lo:400: 00000100:00100000:3.0:1788927288.415287:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927288.415326:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262336 00000100:00100000:3.0:1788927288.415333:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262336 00000100:00100000:3.0:1788927288.415388:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788927288.415398:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075262336:12345-0@lo:400: 00000100:00100000:3.0:1788927288.415481:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075262336:12345-0@lo:400: Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927288.415488:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788927288.415829:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262848 00000100:00100000:1.0:1788927288.415834:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262848 00000100:00100000:1.0:1788927288.415874:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262720 00000100:00100000:1.0:1788927288.415877:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262720 00000100:00100000:1.0:1788927288.415887:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262592 00000100:00100000:1.0:1788927288.415889:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262592 00000100:00100000:1.0:1788927288.415901:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788927288.415906:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075262848:12345-0@lo:400: 00000100:00100000:1.0:1788927288.415964:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075262848:12345-0@lo:400: Request processed in 57us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927288.415970:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788927288.415983:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788927288.415989:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075262720:12345-0@lo:400: 00000100:00100000:1.0:1788927288.416016:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075262720:12345-0@lo:400: Request processed in 28us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927288.416021:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788927288.416032:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788927288.416037:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075262592:12345-0@lo:400: 00000100:00100000:1.0:1788927288.416062:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075262592:12345-0@lo:400: Request processed in 25us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927288.416068:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788927288.416242:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484f480 x1875826075262720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927288.416277:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075262720:0@lo:400: 00010000:00080000:1.0:1788927288.416292:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484d180 x1875826075262848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927288.416300:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075262848:0@lo:400: 00000100:00100000:0.0:1788927288.417348:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075262336:0@lo:400: 00010000:00080000:0.0:1788927288.417365:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484ed80 x1875826075262592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788927304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927288.417376:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075262592:0@lo:400: 00000100:00080000:3.0:1788927288.418341:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:0.0:1788927288.907210:0:8529:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788927288.909294:0:8529:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788927289.246195:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788927289.948249:0:8577:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788927289.948260:0:8577:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788927290.266843:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927290.381866:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.381955:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053218432 00000100:00100000:2.0:1788927290.381969:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053218432 00000100:00100000:2.0:1788927290.382023:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 114 00000100:00100000:2.0:1788927290.382034:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1875826053218432:12345-192.168.203.54@tcp:250: 00010000:00080000:2.0:1788927290.382075:0:5948:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 24092ab7-bf87-4b0f-8781-22219a15f18b@192.168.203.54@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788927290.382120:0:5948:0:(genops.c:1385:class_connect()) connect: client 24092ab7-bf87-4b0f-8781-22219a15f18b, cookie 0x750239bd504e94b8 00000100:00080000:2.0:1788927290.382296:0:5948:0:(import.c:65:import_set_state_nolock()) ffff91884391c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788927290.382385:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+5:2359:x1875826053218432:12345-192.168.203.54@tcp:250: Request processed in 352us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.382401:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 114 00000100:00100000:3.0:1788927290.388794:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927290.388919:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053218560 00000100:00100000:0.0:1788927290.388932:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053218560 00000100:00100000:0.0:1788927290.389005:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 115 00000100:00100000:0.0:1788927290.389018:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+5:5438:x1875826053218560:12345-192.168.203.54@tcp:101: 00010000:00010000:0.0:1788927290.389040:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927290.389065:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db892 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927290.389102:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927290.389115:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 6 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927290.389126:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0000, rc 0) 00000100:00100000:0.0:1788927290.389203:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+6:5438:x1875826053218560:12345-192.168.203.54@tcp:101: Request processed in 188us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927290.389210:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 115 00000100:00100000:1.0:1788927290.395492:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927290.395691:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053218688 00000100:00100000:0.0:1788927290.395705:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053218688 00000100:00100000:0.0:1788927290.395784:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 116 00000100:00100000:0.0:1788927290.395797:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+6:5438:x1875826053218688:12345-192.168.203.54@tcp:501: 00000100:00100000:0.0:1788927290.396038:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+6:5438:x1875826053218688:12345-192.168.203.54@tcp:501: Request processed in 235us (555us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927290.396048:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 116 00000100:00100000:1.0:1788927290.405564:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.405880:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053218816 00000100:00100000:2.0:1788927290.405892:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053218816 00000100:00100000:2.0:1788927290.405968:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 117 00000100:00100000:2.0:1788927290.405979:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+6:5438:x1875826053218816:12345-192.168.203.54@tcp:101: 00010000:00010000:2.0:1788927290.406001:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927290.406026:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db899 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927290.406063:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927290.406076:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 7 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927290.406102:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189413c8400, rc 0) 00000100:00100000:2.0:1788927290.406169:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+7:5438:x1875826053218816:12345-192.168.203.54@tcp:101: Request processed in 192us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.406176:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 117 00000100:00100000:2.0:1788927290.408853:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927290.408958:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053218944 00000100:00100000:3.0:1788927290.408971:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053218944 00000100:00100000:3.0:1788927290.409033:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 118 00000100:00100000:3.0:1788927290.409044:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+7:5438:x1875826053218944:12345-192.168.203.54@tcp:501: 00000100:00100000:3.0:1788927290.409249:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5438:x1875826053218944:12345-192.168.203.54@tcp:501: Request processed in 205us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927290.409257:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 118 00000100:00100000:1.0:1788927290.416382:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927290.416487:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219072 00000100:00100000:0.0:1788927290.416500:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219072 00000100:00100000:0.0:1788927290.416565:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 119 00000100:00100000:0.0:1788927290.416576:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5438:x1875826053219072:12345-192.168.203.54@tcp:503: 00000100:00100000:0.0:1788927290.416921:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5438:x1875826053219072:12345-192.168.203.54@tcp:503: Request processed in 345us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927290.416930:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 119 00000100:00100000:1.0:1788927290.425048:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.425167:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219200 00000100:00100000:2.0:1788927290.425180:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219200 00000100:00100000:2.0:1788927290.425245:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 120 00000100:00100000:2.0:1788927290.425256:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5457:x1875826053219200:12345-192.168.203.54@tcp:502: 00000100:00100000:2.0:1788927290.425469:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5457:x1875826053219200:12345-192.168.203.54@tcp:502: Request processed in 213us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.425477:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 120 00000100:00100000:0.0:1788927290.466714:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.466904:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219328 00000100:00100000:2.0:1788927290.466917:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219328 00000100:00100000:2.0:1788927290.466986:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 121 00000100:00100000:2.0:1788927290.466999:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5457:x1875826053219328:12345-192.168.203.54@tcp:502: 00000100:00100000:2.0:1788927290.467188:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5457:x1875826053219328:12345-192.168.203.54@tcp:502: Request processed in 191us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.467198:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 121 00000100:00100000:1.0:1788927290.470821:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927290.470922:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219456 00000100:00100000:3.0:1788927290.470934:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219456 00000100:00100000:3.0:1788927290.471002:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 122 00000100:00100000:3.0:1788927290.471014:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+8:5438:x1875826053219456:12345-192.168.203.54@tcp:101: 00010000:00010000:3.0:1788927290.471036:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927290.471083:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820df800/0x750239bd504e94cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db8c3 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927290.471120:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820df800/0x750239bd504e94cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8c3 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927290.471134:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820df800/0x750239bd504e94cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8c3 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927290.471145:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df800, rc 0) 00000100:00100000:3.0:1788927290.471219:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5438:x1875826053219456:12345-192.168.203.54@tcp:101: Request processed in 207us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927290.471226:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 122 00000100:00100000:1.0:1788927290.480554:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927290.480758:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219584 00000100:00100000:0.0:1788927290.480772:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219584 00000100:00100000:0.0:1788927290.480841:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 123 00000100:00100000:0.0:1788927290.480854:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5438:x1875826053219584:12345-192.168.203.54@tcp:256: 20000000:01000000:0.0:1788927290.480888:0:5948:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788927290.480929:0:5948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788927290.480934:0:5948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788927290.480938:0:5948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788927290.480940:0:5948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788927290.489908:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5438:x1875826053219584:12345-192.168.203.54@tcp:256: Request processed in 9031us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.489926:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 123 00000100:00100000:1.0:1788927290.497536:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.497740:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219712 00000100:00100000:2.0:1788927290.497753:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219712 00000100:00100000:2.0:1788927290.497824:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 124 00000100:00100000:2.0:1788927290.497855:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5438:x1875826053219712:12345-192.168.203.54@tcp:101: 00010000:00010000:2.0:1788927290.497876:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927290.497905:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db8ca expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927290.497939:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927290.497952:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927290.497963:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189413c9400, rc 0) 00000100:00100000:2.0:1788927290.498081:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5438:x1875826053219712:12345-192.168.203.54@tcp:101: Request processed in 229us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.498089:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 124 00000100:00100000:1.0:1788927290.508878:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.509019:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219840 00000100:00100000:2.0:1788927290.509033:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219840 00000100:00100000:2.0:1788927290.509162:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 125 00000100:00100000:2.0:1788927290.509188:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5438:x1875826053219840:12345-192.168.203.54@tcp:501: 00000100:00100000:2.0:1788927290.509547:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5438:x1875826053219840:12345-192.168.203.54@tcp:501: Request processed in 372us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.509558:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 125 00000100:00100000:0.0:1788927290.512322:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927290.512404:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053219968 00000100:00100000:3.0:1788927290.512414:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053219968 00000100:00100000:3.0:1788927290.512489:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 126 00000100:00100000:3.0:1788927290.512500:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5438:x1875826053219968:12345-192.168.203.54@tcp:503: 00000100:00100000:3.0:1788927290.512668:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5438:x1875826053219968:12345-192.168.203.54@tcp:503: Request processed in 170us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927290.512676:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 126 00000100:00100000:1.0:1788927290.522025:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927290.522243:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220096 00000100:00100000:2.0:1788927290.522256:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220096 00000100:00100000:2.0:1788927290.522327:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 127 00000100:00100000:2.0:1788927290.522345:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5461:x1875826053220096:12345-192.168.203.54@tcp:502: 00000100:00100000:2.0:1788927290.522556:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5461:x1875826053220096:12345-192.168.203.54@tcp:502: Request processed in 219us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927290.522571:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 127 00000100:00100000:1.0:1788927290.528470:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927290.529212:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220224 00000100:00100000:0.0:1788927290.529229:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220224 00000100:00100000:0.0:1788927290.529312:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 128 00000100:00100000:0.0:1788927290.529323:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5461:x1875826053220224:12345-192.168.203.54@tcp:502: 00000100:00100000:0.0:1788927290.529534:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5461:x1875826053220224:12345-192.168.203.54@tcp:502: Request processed in 212us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927290.529544:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 128 00000100:00100000:0.0:1788927290.537838:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927290.538010:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220352 00000100:00100000:1.0:1788927290.538023:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220352 00000100:00100000:1.0:1788927290.538146:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:1.0:1788927290.538157:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2359:x1875826053220352:12345-192.168.203.54@tcp:38: 00010000:00080000:1.0:1788927290.538196:0:5956:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:1.0:1788927290.538255:0:5956:0:(genops.c:1385:class_connect()) connect: client 20893ea2-62f1-4ff2-a5ab-c8ef32fae354, cookie 0x750239bd504e94db 00000004:00100000:1.0:1788927290.538287:0:5956:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788927290.538294:0:5956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788927290.550750:0:5956:0:(import.c:65:import_set_state_nolock()) ffff918842fa0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788927290.550874:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2359:x1875826053220352:12345-192.168.203.54@tcp:38: Request processed in 12716us (13048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927290.550887:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00010000:00010000:1.0:1788927291.292547:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927291.568316:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927291.568477:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220608 00000100:00100000:2.0:1788927291.568490:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220608 00000100:00100000:2.0:1788927291.568620:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:2.0:1788927291.568636:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5438:x1875826053220608:12345-192.168.203.54@tcp:41: 00000100:00100000:0.0:1788927291.568637:0:5954:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000004:00000024:2.0:1788927291.568688:0:5955:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:0.0:1788927291.568854:0:5954:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788927291.568898:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927291.569336:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5438:x1875826053220608:12345-192.168.203.54@tcp:41: Request processed in 695us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927291.569349:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:0.0:1788927291.570591:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927291.571083:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220480 00000100:00100000:2.0:1788927291.571092:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220480 00000100:00100000:1.0:1788927291.571665:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:1.0:1788927291.571680:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:0:x1875826053220480:12345-192.168.203.54@tcp:41: 00000004:00000024:1.0:1788927291.571712:0:5956:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:1.0:1788927291.571820:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:0:x1875826053220480:12345-192.168.203.54@tcp:41: Request processed in 145us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927291.571828:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:3.0:1788927291.572122:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927291.572202:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220736 00000100:00100000:1.0:1788927291.572207:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220736 00000100:00100000:1.0:1788927291.572268:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:1.0:1788927291.572276:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5438:x1875826053220736:12345-192.168.203.54@tcp:40: 00000100:00100000:1.0:1788927291.572320:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5438:x1875826053220736:12345-192.168.203.54@tcp:40: Request processed in 45us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927291.572326:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:0.0:1788927291.575352:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927291.575956:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220864 00000100:00100000:1.0:1788927291.575966:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220864 00000100:00100000:1.0:1788927291.576008:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:1.0:1788927291.576016:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1875826053220864:12345-192.168.203.54@tcp:8: 00010000:00080000:1.0:1788927291.576044:0:6943:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1788927291.576072:0:6943:0:(genops.c:1385:class_connect()) connect: client 20893ea2-62f1-4ff2-a5ab-c8ef32fae354, cookie 0x750239bd504e94e2 00002000:00100000:1.0:1788927291.576084:0:6943:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20893ea2-62f1-4ff2-a5ab-c8ef32fae354/ffff918842fa3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788927291.576117:0:6943:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788927291.576277:0:6943:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788927291.576304:0:6943:0:(import.c:65:import_set_state_nolock()) ffff918842fb3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788927291.576365:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2359:x1875826053220864:12345-192.168.203.54@tcp:8: Request processed in 348us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927291.576373:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:0.0:1788927291.577844:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927291.577881:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927291.578036:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221120 00000100:00100000:3.0:1788927291.578044:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221120 00000100:00100000:3.0:1788927291.578088:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 129 00000100:00100000:3.0:1788927291.578096:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053221120:12345-192.168.203.54@tcp:400: 00000100:00100000:1.0:1788927291.578222:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053220992 00000100:00100000:1.0:1788927291.578226:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053220992 00000100:00100000:1.0:1788927291.578247:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:1.0:1788927291.578252:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1875826053220992:12345-192.168.203.54@tcp:8: 00010000:00080000:1.0:1788927291.578274:0:6942:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1788927291.578311:0:6942:0:(genops.c:1385:class_connect()) connect: client 20893ea2-62f1-4ff2-a5ab-c8ef32fae354, cookie 0x750239bd504e94e9 00002000:00100000:1.0:1788927291.578320:0:6942:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20893ea2-62f1-4ff2-a5ab-c8ef32fae354/ffff918842fb6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788927291.578334:0:6942:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788927291.578494:0:6942:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788927291.578517:0:6942:0:(import.c:65:import_set_state_nolock()) ffff918842fb0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788927291.578562:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053221120:12345-192.168.203.54@tcp:400: Request processed in 465us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927291.578583:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 129 00000100:00100000:1.0:1788927291.582034:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2359:x1875826053220992:12345-192.168.203.54@tcp:8: Request processed in 3769us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927291.582048:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:2.0:1788927291.586209:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927291.587658:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221248 00000100:00100000:1.0:1788927291.587669:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221248 00000100:00100000:1.0:1788927291.587732:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:1.0:1788927291.587744:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5438:x1875826053221248:12345-192.168.203.54@tcp:33: 00000004:00080000:3.0:1788927291.620702:0:5957:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32878us 00000004:00200000:3.0:1788927291.655972:0:5957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788927291.656088:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5438:x1875826053221248:12345-192.168.203.54@tcp:33: Request processed in 68341us (69881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927291.656101:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:0.0:1788927291.906084:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927291.906306:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221376 00000100:00100000:3.0:1788927291.906320:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221376 00000100:00100000:3.0:1788927291.906400:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:3.0:1788927291.906413:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5478:x1875826053221376:12345-192.168.203.54@tcp:101: 00010000:00010000:3.0:1788927291.906647:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927291.907104:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df200/0x750239bd504e94f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db8f4 expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927291.907190:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e94f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927291.907204:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e94f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927291.907220:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e94f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927291.907282:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788927291.907286:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788927291.907302:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e94f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927291.907329:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df200/0x750239bd504e94f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8f4 expref: 8 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927291.907378:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e94f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8f4 expref: 7 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927291.907388:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:3.0:1788927291.907391:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788927291.907394:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de400, rc 0) 00000100:00100000:3.0:1788927291.907477:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:5478:x1875826053221376:12345-192.168.203.54@tcp:101: Request processed in 1066us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927291.907486:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00010000:00010000:2.0:1788927292.315310:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927293.020303:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075262976:0@lo:13: 00000100:00100000:1.0:1788927293.020408:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927293.021170:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075262976 00000100:00100000:0.0:1788927293.021184:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075262976 00000100:00100000:0.0:1788927293.021269:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788927293.021292:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075262976:12345-0@lo:13: 00002000:00000024:0.0:1788927293.021322:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927293.021411:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075262976:12345-0@lo:13: Request processed in 132us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927293.021419:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788927293.021481:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd2bb80 x1875826075262976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927293.021509:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075262976:0@lo:13: 00000100:00080000:3.0:1788927293.021567:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788927293.339015:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927293.531860:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788927293.531894:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075263104:0@lo:13: 00000100:00100000:2.0:1788927293.531971:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927293.532081:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263104 00000100:00100000:0.0:1788927293.532090:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263104 00000100:00100000:0.0:1788927293.532161:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788927293.532172:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075263104:12345-0@lo:13: 00002000:00000024:0.0:1788927293.532212:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927293.532261:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075263104:12345-0@lo:13: Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927293.532267:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788927293.532529:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788927293.532558:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd29f80 x1875826075263104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927293.532577:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075263104:0@lo:13: 00000100:00100000:2.0:1788927293.532826:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075263616:0@lo:400: 00000100:00100000:2.0:1788927293.532857:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927293.532897:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788927293.532904:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075263488:0@lo:400: 00000100:00100000:2.0:1788927293.532927:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927293.532955:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263616 00000100:00100000:2.0:1788927293.532960:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263616 00000100:00080000:2.0:1788927293.532975:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927293.533000:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263488 00000100:00100000:2.0:1788927293.533003:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263488 00000100:00080000:2.0:1788927293.533015:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927293.533032:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788927293.533039:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075263616:12345-0@lo:400: 00000100:00100000:2.0:1788927293.533076:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075263616:12345-0@lo:400: Request processed in 38us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927293.533082:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788927293.533107:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075263616:0@lo:400: 00000100:00100000:2.0:1788927293.533124:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788927293.533131:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075263488:12345-0@lo:400: 00000100:00100000:2.0:1788927293.533161:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075263488:12345-0@lo:400: Request processed in 31us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927293.533167:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788927293.533285:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075263360:0@lo:400: 00000100:00100000:1.0:1788927293.533317:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927293.533331:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788927293.533337:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075263232:0@lo:400: 00000100:00100000:1.0:1788927293.533380:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927293.533416:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263360 00000100:00100000:1.0:1788927293.533420:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263360 00000100:00100000:1.0:1788927293.533442:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788927293.533448:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075263360:12345-0@lo:400: 00000100:00100000:1.0:1788927293.533481:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075263360:12345-0@lo:400: Request processed in 33us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927293.533487:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788927293.533516:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075263360:0@lo:400: 00000100:00100000:1.0:1788927293.533547:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263232 00000100:00100000:1.0:1788927293.533551:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263232 00000100:00100000:1.0:1788927293.533577:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788927293.533583:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075263232:12345-0@lo:400: 00000100:00100000:1.0:1788927293.533641:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075263232:12345-0@lo:400: Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927293.533648:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788927293.533679:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075263232:0@lo:400: 00000100:00100000:2.0:1788927293.533945:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075263488:0@lo:400: 00000100:00100000:1.0:1788927294.310141:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927294.310269:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221504 00000100:00100000:2.0:1788927294.310281:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221504 00000100:00100000:2.0:1788927294.310387:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:2.0:1788927294.310400:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:5531:x1875826053221504:12345-192.168.203.54@tcp:41: 00000004:00000024:2.0:1788927294.310452:0:5954:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:2.0:1788927294.310540:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:5531:x1875826053221504:12345-192.168.203.54@tcp:41: Request processed in 142us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927294.310581:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00080000:0.0:1788927294.310775:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927294.318982:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927294.330221:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221632 00000100:00100000:0.0:1788927294.330243:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221632 00000100:00100000:0.0:1788927294.330498:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:0.0:1788927294.330513:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5531:x1875826053221632:12345-192.168.203.54@tcp:13: 00002000:00000024:0.0:1788927294.330550:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927294.330710:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5531:x1875826053221632:12345-192.168.203.54@tcp:13: Request processed in 199us (11742us total) trans 0 rc 0/0 00000100:00080000:2.0:1788927294.331273:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788927294.333749:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927294.340258:0:6944:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788927294.340284:0:6944:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788927294.344751:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:0.0:1788927294.344840:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221760 00000100:00100000:0.0:1788927294.344852:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221760 00000100:00100000:0.0:1788927294.344928:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:0.0:1788927294.344940:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5531:x1875826053221760:12345-192.168.203.54@tcp:13: 00002000:00000024:0.0:1788927294.344975:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1788927294.346401:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788927294.347789:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:5531:x1875826053221760:12345-192.168.203.54@tcp:13: Request processed in 2837us (14039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927294.347832:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00010000:00010000:2.0:1788927294.371930:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927295.387692:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788927295.591058:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000001:00100000:3.0:1788927295.592722:0:5933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00010000:00010000:1.0:1788927296.424344:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927297.031048:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927297.031099:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927297.031130:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927297.031169:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927297.031207:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222016 00000100:00100000:0.0:1788927297.031219:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222016 00000100:00100000:0.0:1788927297.031298:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00100000:0.0:1788927297.031309:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053222016:12345-192.168.203.54@tcp:400: 00000100:00100000:0.0:1788927297.031408:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053222016:12345-192.168.203.54@tcp:400: Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927297.031417:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00080000:0.0:1788927297.031444:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927297.031527:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053221888 00000100:00100000:2.0:1788927297.031532:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053221888 00000100:00100000:2.0:1788927297.031577:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 131 00000100:00100000:2.0:1788927297.031585:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053221888:12345-192.168.203.54@tcp:400: 00000100:00100000:2.0:1788927297.031647:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053221888:12345-192.168.203.54@tcp:400: Request processed in 63us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927297.031654:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 131 00000100:00100000:3.0:1788927297.032128:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222144 00000100:00100000:3.0:1788927297.032135:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222144 00000100:00100000:3.0:1788927297.032184:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222272 00000100:00100000:3.0:1788927297.032187:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222272 00000100:00100000:3.0:1788927297.032205:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:3.0:1788927297.032214:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053222144:12345-192.168.203.54@tcp:400: 00000100:00100000:3.0:1788927297.032251:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053222144:12345-192.168.203.54@tcp:400: Request processed in 40us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927297.032259:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:3.0:1788927297.032292:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:3.0:1788927297.032298:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053222272:12345-192.168.203.54@tcp:400: 00000100:00100000:3.0:1788927297.032323:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053222272:12345-192.168.203.54@tcp:400: Request processed in 26us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927297.032330:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00080000:2.0:1788927297.032550:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788927297.032554:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788927297.340453:0:8677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788927297.439821:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788927297.642950:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000100:00100000:3.0:1788927298.139399:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075263744:0@lo:13: 00000100:00100000:3.0:1788927298.139508:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927298.139795:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263744 00000100:00100000:0.0:1788927298.139806:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263744 00000100:00100000:0.0:1788927298.139895:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788927298.139906:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075263744:12345-0@lo:13: 00002000:00000024:0.0:1788927298.139944:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927298.139998:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075263744:12345-0@lo:13: Request processed in 94us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927298.140022:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788927298.140209:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788927298.140677:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd29c00 x1875826075263744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927298.140702:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075263744:0@lo:13: 00010000:00010000:1.0:1788927298.469574:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927298.655657:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927298.655692:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075263872:0@lo:13: 00000100:00100000:3.0:1788927298.655759:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927298.655822:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075263872 00000100:00100000:3.0:1788927298.655829:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075263872 00000100:00100000:3.0:1788927298.655892:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788927298.655900:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075263872:12345-0@lo:13: 00002000:00000024:3.0:1788927298.655929:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788927298.655972:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075263872:12345-0@lo:13: Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927298.655979:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788927298.656000:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788927298.656028:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918945929f80 x1875826075263872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927298.656047:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918945929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075263872:0@lo:13: 00000100:00100000:3.0:1788927298.656535:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075264000:0@lo:400: 00000100:00100000:3.0:1788927298.656571:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927298.656728:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788927298.656736:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075264128:0@lo:400: 00000100:00100000:3.0:1788927298.656765:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927298.656874:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927298.656884:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075264256:0@lo:400: 00000100:00100000:2.0:1788927298.656914:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927298.656938:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075264000 00000100:00100000:1.0:1788927298.656942:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075264000 00000100:00100000:2.0:1788927298.656944:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075264384:0@lo:400: 00000100:00100000:2.0:1788927298.656964:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927298.656976:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788927298.656984:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075264000:12345-0@lo:400: 00000100:00100000:2.0:1788927298.656993:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075264128 00000100:00100000:2.0:1788927298.656996:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075264128 00000100:00100000:2.0:1788927298.657021:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075264256 00000100:00100000:2.0:1788927298.657024:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075264256 00000100:00100000:1.0:1788927298.657024:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075264000:12345-0@lo:400: Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927298.657031:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788927298.657053:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075264384 00000100:00100000:2.0:1788927298.657057:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075264384 00000100:00100000:2.0:1788927298.657073:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788927298.657073:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075264000:0@lo:400: 00000100:00100000:2.0:1788927298.657079:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075264128:12345-0@lo:400: 00000100:00100000:1.0:1788927298.657102:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788927298.657109:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075264256:12345-0@lo:400: 00000100:00100000:2.0:1788927298.657122:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075264128:12345-0@lo:400: Request processed in 43us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927298.657128:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788927298.657137:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075264256:12345-0@lo:400: Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927298.657141:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788927298.657145:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788927298.657147:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075264384:12345-0@lo:400: 00000100:00100000:1.0:1788927298.657167:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075264256:0@lo:400: 00000100:00100000:2.0:1788927298.657173:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075264384:12345-0@lo:400: Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927298.657179:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788927298.657179:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075264384:0@lo:400: 00000100:00080000:2.0:1788927298.657194:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927298.657196:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075264128:0@lo:400: 00010000:00010000:0.0:1788927299.484008:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927300.508433:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927301.531457:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788927302.012692:0:8825:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3701ede0 20000000:00000080:3.0:1788927302.012721:0:8825:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9188445fb000 uarg=0000000000000000 20000000:01000000:3.0:1788927302.013362:0:8825:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788927302.013366:0:8825:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788927302.013369:0:8825:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788927302.013445:0:8825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788927302.013452:0:8825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788927302.013530:0:8825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788927302.013533:0:8825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788927302.027487:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788927302.027981:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788927302.028014:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788927302.028028:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788927302.028039:0:8825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788927302.028042:0:8825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788927302.028807:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788927302.029093:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788927302.029119:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788927302.029137:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788927302.029148:0:8825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788927302.029150:0:8825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788927302.029651:0:8828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788927302.030005:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788927302.030030:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788927302.030042:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788927302.030054:0:8825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788927302.030056:0:8825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788927302.043539:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788927302.043989:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788927302.044020:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788927302.044033:0:8825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788927302.044050:0:8825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788927302.044072:0:8825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044095:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e93f4 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044104:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e941e expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044112:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9448 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044119:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9456 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044127:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9464 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044158:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9480 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044165:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e94aa expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044176:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044185:0:8825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044192:0:8825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044257:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044275:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044292:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264512:192.168.203.54@tcp:104: 00010000:00010000:0.0:1788927302.044439:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 9 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044449:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 9 pid: 5949 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044459:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264640:192.168.203.54@tcp:104: 00010000:00010000:0.0:1788927302.044504:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e94aa expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044513:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e94aa expref: 18 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044523:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264768:0@lo:104: 00000100:00100000:0.0:1788927302.044571:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927302.044654:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9480 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044662:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9480 expref: 18 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044671:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264896:0@lo:104: 00000100:00100000:0.0:1788927302.044699:0:8825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927302.044730:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9464 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044737:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9464 expref: 18 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044745:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265024:0@lo:104: 00010000:00010000:0.0:1788927302.044770:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9456 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044777:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9456 expref: 18 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044784:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265152:0@lo:104: 00010000:00010000:0.0:1788927302.044836:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9448 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044845:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9448 expref: 18 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044854:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265280:0@lo:104: 00010000:00010000:0.0:1788927302.044877:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e941e expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044887:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e941e expref: 18 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044895:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265408:0@lo:104: 00010000:00010000:0.0:1788927302.044918:0:8825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e93f4 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.044927:0:8825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e93f4 expref: 18 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.044934:0:8825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265536:0@lo:104: 00000100:00100000:0.0:1788927302.044954:0:8825:0:(client.c:2715:ptlrpc_set_wait()) set ffff91894371a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927302.044997:0:5937:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788927302.045017:0:5937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927302.045031:0:5937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927302.045040:0:5937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927302.045050:0:5937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927302.045059:0:5937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927302.045068:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075264768 00000100:00100000:0.0:1788927302.045076:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075264768 00000100:00100000:0.0:1788927302.045128:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075264896 00000100:00100000:0.0:1788927302.045132:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075264896 00000100:00100000:0.0:1788927302.045142:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265024 00000100:00100000:0.0:1788927302.045145:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265024 00000100:00100000:0.0:1788927302.045153:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265152 00000100:00100000:0.0:1788927302.045156:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265152 00000100:00100000:0.0:1788927302.045166:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265280 00000100:00100000:0.0:1788927302.045168:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265280 00000100:00100000:0.0:1788927302.045176:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265408 00000100:00100000:0.0:1788927302.045178:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265408 00000100:00100000:0.0:1788927302.045208:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265536 00000100:00100000:0.0:1788927302.045211:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265536 00000100:00100000:0.0:1788927302.045225:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788927302.045235:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+9:8825:x1875826075264768:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045249:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045319:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788927302.045327:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+9:8825:x1875826075264768:12345-0@lo:104: Request processed in 93us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045335:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788927302.045354:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788927302.045360:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897df08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+8:8825:x1875826075264896:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045368:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045401:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788927302.045407:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897df08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+8:8825:x1875826075264896:12345-0@lo:104: Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045413:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788927302.045458:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788927302.045464:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+7:8825:x1875826075265024:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045471:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045500:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788927302.045505:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+7:8825:x1875826075265024:12345-0@lo:104: Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045512:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788927302.045524:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788927302.045529:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+6:8825:x1875826075265152:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045536:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045560:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788927302.045565:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+6:8825:x1875826075265152:12345-0@lo:104: Request processed in 36us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045571:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788927302.045582:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788927302.045588:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+5:8825:x1875826075265280:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045628:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045656:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788927302.045661:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+5:8825:x1875826075265280:12345-0@lo:104: Request processed in 74us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045667:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788927302.045687:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788927302.045692:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+4:8825:x1875826075265408:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045700:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045728:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788927302.045733:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+4:8825:x1875826075265408:12345-0@lo:104: Request processed in 42us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045738:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788927302.045751:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788927302.045757:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:8825:x1875826075265536:12345-0@lo:104: 00010000:00010000:0.0:1788927302.045763:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.045790:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788927302.045794:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:8825:x1875826075265536:12345-0@lo:104: Request processed in 38us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.045800:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788927302.045857:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264768:0@lo:104: 00000100:00100000:0.0:1788927302.045867:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264896:0@lo:104: 00000100:00100000:0.0:1788927302.045874:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265024:0@lo:104: 00000100:00100000:0.0:1788927302.045880:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265152:0@lo:104: 00000100:00100000:0.0:1788927302.045888:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265280:0@lo:104: 00000100:00100000:0.0:1788927302.045896:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265408:0@lo:104: 00000100:00100000:0.0:1788927302.045901:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075265536:0@lo:104: 00010000:00010000:2.0:1788927302.046197:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788927302.046206:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046214:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820dfc00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046219:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046228:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046236:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046252:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046299:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046307:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046340:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046347:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189820dfc00/0x750239bd504e94aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e94b1 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046362:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788927302.046365:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046382:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046385:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046393:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046399:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046405:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046419:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046425:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046430:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046436:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e9480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9487 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046447:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788927302.046455:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046462:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779400 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046465:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046472:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046478:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046484:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046499:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046506:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046524:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046530:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779400/0x750239bd504e9464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e946b expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046539:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788927302.046542:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046548:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189413c8a00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046551:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046568:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046575:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046580:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046626:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046632:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046639:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046646:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189413c8a00/0x750239bd504e9456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e945d expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046657:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788927302.046661:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046667:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189413c9200 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046670:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046676:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046683:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046694:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046707:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046713:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046717:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046725:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189413c9200/0x750239bd504e9448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e944f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046735:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788927302.046738:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046743:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189413c9600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046746:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046752:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046757:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046762:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046773:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046780:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046791:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046798:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189413c9600/0x750239bd504e941e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9425 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046807:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788927302.046810:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046827:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951778600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927302.046830:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046836:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927302.046852:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927302.046858:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788927302.046872:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046878:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927302.046882:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046889:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e93f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e93fb expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.046903:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927302.046910:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927302.046913:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927302.046934:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075265664:0@lo:103: 00000100:00100000:2.0:1788927302.046992:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047038:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075266176:0@lo:103: 00000100:00100000:2.0:1788927302.047062:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047088:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788927302.047094:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075265792:0@lo:103: 00000100:00100000:2.0:1788927302.047114:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047130:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075266304:0@lo:103: 00000100:00100000:2.0:1788927302.047147:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047177:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075265920:0@lo:103: 00000100:00100000:2.0:1788927302.047199:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047208:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075266432:0@lo:103: 00000100:00100000:2.0:1788927302.047225:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047236:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927302.047240:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075266048:0@lo:103: 00000100:00100000:2.0:1788927302.047262:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927302.047295:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265664 00000100:00100000:2.0:1788927302.047302:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265664 00010000:00010000:2.0:1788927302.047331:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e94aa expref: 19 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047351:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266176 00000100:00100000:2.0:1788927302.047354:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266176 00010000:00010000:2.0:1788927302.047366:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9448 expref: 20 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047392:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265792 00000100:00100000:2.0:1788927302.047394:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265792 00010000:00010000:2.0:1788927302.047405:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9480 expref: 21 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047416:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266304 00000100:00100000:2.0:1788927302.047418:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266304 00010000:00010000:2.0:1788927302.047427:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e941e expref: 22 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047436:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075265920 00000100:00100000:2.0:1788927302.047438:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075265920 00010000:00010000:2.0:1788927302.047447:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9464 expref: 23 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047456:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266432 00000100:00100000:2.0:1788927302.047458:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266432 00010000:00010000:2.0:1788927302.047467:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e93f4 expref: 24 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047475:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266048 00000100:00100000:2.0:1788927302.047477:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266048 00010000:00010000:2.0:1788927302.047486:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9456 expref: 25 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.047500:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788927302.047508:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+25:3445:x1875826075265664:12345-0@lo:103: 00010000:00010000:2.0:1788927302.047522:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.047528:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e94aa expref: 25 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047548:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e94aa expref: 25 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047566:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820de200/0x750239bd504e94b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e94aa expref: 25 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047582:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.047646:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+24:3445:x1875826075265664:12345-0@lo:103: Request processed in 139us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.047654:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788927302.047673:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788927302.047680:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+23:3445:x1875826075266176:12345-0@lo:103: 00010000:00010000:2.0:1788927302.047687:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.047691:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9448 expref: 23 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047699:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9448 expref: 23 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047709:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820df000/0x750239bd504e944f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9448 expref: 23 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047717:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.047737:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+22:3445:x1875826075266176:12345-0@lo:103: Request processed in 59us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.047743:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788927302.047753:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788927302.047758:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+21:3445:x1875826075265792:12345-0@lo:103: 00010000:00010000:2.0:1788927302.047769:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.047775:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9480 expref: 21 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047782:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9480 expref: 21 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047791:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951778a00/0x750239bd504e9487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9480 expref: 21 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047799:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.047828:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+20:3445:x1875826075265792:12345-0@lo:103: Request processed in 59us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.047835:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788927302.047846:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788927302.047851:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075266304:12345-0@lo:103: 00010000:00010000:2.0:1788927302.047859:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.047863:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e941e expref: 19 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047871:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e941e expref: 19 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047880:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820dfe00/0x750239bd504e9425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e941e expref: 19 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047887:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.047905:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+18:3445:x1875826075266304:12345-0@lo:103: Request processed in 54us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.047919:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788927302.047929:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788927302.047934:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+17:3443:x1875826075265920:12345-0@lo:103: 00010000:00010000:2.0:1788927302.047941:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.047945:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9464 expref: 17 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047952:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9464 expref: 17 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047962:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918951779200/0x750239bd504e946b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9464 expref: 17 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.047971:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.047994:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+16:3443:x1875826075265920:12345-0@lo:103: Request processed in 60us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.048000:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788927302.048009:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788927302.048015:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+15:3443:x1875826075266432:12345-0@lo:103: 00010000:00010000:2.0:1788927302.048021:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.048025:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e93f4 expref: 15 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.048033:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e93f4 expref: 15 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.048043:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc0400/0x750239bd504e93fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e93f4 expref: 15 pid: 5949 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.048061:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.048080:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+14:3443:x1875826075266432:12345-0@lo:103: Request processed in 66us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.048086:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788927302.048098:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927302.048104:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918950fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+13:3443:x1875826075266048:12345-0@lo:103: 00010000:00010000:2.0:1788927302.048110:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.048114:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9456 expref: 13 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.048122:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9456 expref: 13 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.048131:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820de600/0x750239bd504e945d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9456 expref: 13 pid: 5947 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.048139:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.048157:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918950fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+12:3443:x1875826075266048:12345-0@lo:103: Request processed in 54us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.048162:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927302.048237:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075266048:0@lo:103: 00000100:00100000:2.0:1788927302.048247:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075265920:0@lo:103: 00000100:00100000:2.0:1788927302.048254:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075266432:0@lo:103: 00000100:00100000:2.0:1788927302.048283:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075265792:0@lo:103: 00000100:00100000:2.0:1788927302.048290:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075266304:0@lo:103: 00000100:00100000:2.0:1788927302.048306:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075265664:0@lo:103: 00000100:00100000:2.0:1788927302.048312:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075266176:0@lo:103: 00000100:00100000:2.0:1788927302.054180:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927302.054268:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222528 00000100:00100000:3.0:1788927302.054280:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222528 00010000:00010000:3.0:1788927302.054344:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 10 pid: 5949 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.054439:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264512:192.168.203.54@tcp:104: 00000100:00100000:0.0:1788927302.054461:0:8825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8825:1875826075264640:192.168.203.54@tcp:104: 00000100:00100000:3.0:1788927302.054492:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:3.0:1788927302.054503:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053222528:12345-192.168.203.54@tcp:103: 00010000:00010000:0.0:1788927302.054521:0:8825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927302.054613:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927302.054622:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 10 pid: 5949 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927302.054634:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 10 pid: 5949 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927302.054657:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc0000/0x750239bd504e94bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db892 expref: 10 pid: 5949 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927302.054676:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927302.054743:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24092ab7-bf87-4b0f-8781-22219a15f18b+9:2361:x1875826053222528:12345-192.168.203.54@tcp:103: Request processed in 240us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927302.054751:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:2.0:1788927302.056023:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927302.056066:0:8019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222400 00000100:00100000:2.0:1788927302.056074:0:8019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222400 00010000:00010000:2.0:1788927302.056108:0:8019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927302.056148:0:8019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:2.0:1788927302.056159:0:8019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24092ab7-bf87-4b0f-8781-22219a15f18b+9:2361:x1875826053222400:12345-192.168.203.54@tcp:103: 00010000:00010000:2.0:1788927302.056170:0:8019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927302.056176:0:8019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.056188:0:8019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.056204:0:8019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189413c8400/0x750239bd504e94c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db899 expref: 9 pid: 5948 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.056231:0:8019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.056240:0:8019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927302.057634:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927302.059346:0:8019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059618:0:8019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059628:0:8019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059636:0:8019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059643:0:8019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0e00 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:2.0:1788927302.059649:0:8019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059657:0:8019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059684:0:8019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927302.059700:0:8019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927302.059803:0:8019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24092ab7-bf87-4b0f-8781-22219a15f18b+8:2361:x1875826053222400:12345-192.168.203.54@tcp:103: Request processed in 3638us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927302.059825:0:8019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 20 00010000:00010000:0.0:1788927302.061271:0:8825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.061292:0:8825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927302.061300:0:8825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc0e00/0x750239bd504e94fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927302.146806:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927302.146861:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927302.146888:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927302.146928:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222912 00000100:00100000:1.0:1788927302.146936:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222656 00000100:00100000:1.0:1788927302.146941:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222656 00000100:00100000:0.0:1788927302.146941:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222912 00000100:00100000:1.0:1788927302.147023:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:1.0:1788927302.147035:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2362:x1875826053222656:12345-192.168.203.54@tcp:400: 00000100:00100000:1.0:1788927302.147150:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2362:x1875826053222656:12345-192.168.203.54@tcp:400: Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927302.147158:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:0.0:1788927302.147223:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053222784 00000100:00100000:0.0:1788927302.147227:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053222784 00000100:00100000:0.0:1788927302.147245:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:0.0:1788927302.147253:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2362:x1875826053222912:12345-192.168.203.54@tcp:400: 00000100:00100000:0.0:1788927302.147284:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2362:x1875826053222912:12345-192.168.203.54@tcp:400: Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.147290:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:0.0:1788927302.147304:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:0.0:1788927302.147322:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2362:x1875826053222784:12345-192.168.203.54@tcp:400: 00000100:00100000:0.0:1788927302.147347:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2362:x1875826053222784:12345-192.168.203.54@tcp:400: Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927302.147360:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00080000:1.0:1788927302.153249:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788927302.153537:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788927302.153544:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788927302.557436:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927303.263496:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927303.263530:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075266560:0@lo:13: 00000100:00100000:3.0:1788927303.263659:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.263890:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266560 00000100:00100000:1.0:1788927303.263902:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266560 00000100:00100000:1.0:1788927303.263987:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788927303.264000:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075266560:12345-0@lo:13: 00002000:00000024:1.0:1788927303.264038:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927303.264101:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945928380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075266560:12345-0@lo:13: Request processed in 104us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.264108:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788927303.264325:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788927303.264801:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd2ad80 x1875826075266560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927303.264842:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075266560:0@lo:13: 00010000:00010000:1.0:1788927303.588628:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788927303.643131:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788927303.643144:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9188410d4800 from 39 10000000:01000000:0.0:1788927303.643151:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788927303.643360:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.643375:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.643390:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927303.643489:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075266688:0@lo:101: 00000100:00100000:0.0:1788927303.643588:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927303.643834:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.662505:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266688 00000100:00100000:1.0:1788927303.662528:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266688 00000100:00100000:1.0:1788927303.662648:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788927303.662661:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+12:5951:x1875826075266688:12345-0@lo:101: 00010000:00010000:1.0:1788927303.662685:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927303.662716:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951779200/0x750239bd504e950c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9505 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.662762:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951779200/0x750239bd504e950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9505 expref: 13 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.662779:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951779200/0x750239bd504e950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9505 expref: 13 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.662832:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951779200, rc 0) 00000100:00100000:1.0:1788927303.662955:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075266688:12345-0@lo:101: Request processed in 295us (19365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.662964:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788927303.663678:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075266688:0@lo:101: 00010000:00010000:0.0:1788927303.663704:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e950c expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.663716:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e950c expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927303.663823:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075266816:0@lo:501: 00000100:00100000:0.0:1788927303.663899:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927303.663944:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.664408:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266816 00000100:00100000:1.0:1788927303.664424:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266816 00000100:00100000:1.0:1788927303.664474:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788927303.664485:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075266816:12345-0@lo:501: 00000100:00100000:1.0:1788927303.664697:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075266816:12345-0@lo:501: Request processed in 212us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.664705:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788927303.664853:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075266816:0@lo:501: 00000100:00100000:3.0:1788927303.664929:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075266944:0@lo:503: 00000100:00100000:3.0:1788927303.664978:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.665003:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.665977:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075266944 00000100:00100000:2.0:1788927303.665989:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075266944 00000100:00100000:2.0:1788927303.666061:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788927303.666073:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075266944:12345-0@lo:503: 00000100:00100000:2.0:1788927303.666272:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075266944:12345-0@lo:503: Request processed in 201us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.666280:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788927303.666575:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075266944:0@lo:503: 00000100:00100000:3.0:1788927303.675456:0:8841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8841:1875826075267072:0@lo:502: 00000100:00100000:3.0:1788927303.675586:0:8841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.675684:0:8841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.676498:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267072 00000100:00100000:2.0:1788927303.676511:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267072 00000100:00100000:2.0:1788927303.676625:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788927303.676640:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:8841:x1875826075267072:12345-0@lo:502: 00000100:00100000:2.0:1788927303.676893:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:8841:x1875826075267072:12345-0@lo:502: Request processed in 257us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.676901:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788927303.687404:0:8841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8841:1875826075267072:0@lo:502: 00000100:00100000:3.0:1788927303.687533:0:8841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8841:1875826075267200:0@lo:502: 00000100:00100000:3.0:1788927303.687650:0:8841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.687717:0:8841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.688087:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267200 00000100:00100000:1.0:1788927303.688097:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267200 00000100:00100000:1.0:1788927303.688179:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788927303.688191:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8841:x1875826075267200:12345-0@lo:502: 00000100:00100000:1.0:1788927303.688374:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+13:8841:x1875826075267200:12345-0@lo:502: Request processed in 184us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.688383:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788927303.688621:0:8841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8841:1875826075267200:0@lo:502: 00000040:00080000:3.0:1788927303.688652:0:8841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788927303.688944:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788927303.688971:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788927303.688986:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e950c expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.688999:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc0e00/0x750239bd504e9505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e950c expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927303.689010:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788927303.689013:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788927303.689016:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788927303.689061:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.689071:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.689082:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927303.689101:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267328:0@lo:101: 00000100:00100000:0.0:1788927303.689148:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927303.689197:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.689349:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267328 00000100:00100000:2.0:1788927303.689355:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267328 00000100:00100000:2.0:1788927303.689410:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788927303.689420:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+13:5951:x1875826075267328:12345-0@lo:101: 00010000:00010000:2.0:1788927303.689432:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927303.689448:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9188448c6800/0x750239bd504e951a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9513 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.689480:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9188448c6800/0x750239bd504e951a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9513 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.689493:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9188448c6800/0x750239bd504e951a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9513 expref: 14 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.689504:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c6800, rc 0) 00000100:00100000:2.0:1788927303.689553:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075267328:12345-0@lo:101: Request processed in 135us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.689560:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788927303.689683:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267328:0@lo:101: 00010000:00010000:0.0:1788927303.689697:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e951a expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.689707:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e951a expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927303.689772:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267456:0@lo:501: 00000100:00100000:0.0:1788927303.689799:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927303.689836:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.689880:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267456 00000100:00100000:2.0:1788927303.689885:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267456 00000100:00100000:2.0:1788927303.689903:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788927303.689909:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075267456:12345-0@lo:501: 00000100:00100000:2.0:1788927303.690048:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075267456:12345-0@lo:501: Request processed in 138us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.690056:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788927303.690470:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267456:0@lo:501: 00000100:00100000:0.0:1788927303.690504:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267584:0@lo:503: 00000100:00100000:0.0:1788927303.690550:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927303.690573:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.690627:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267584 00000100:00100000:2.0:1788927303.690632:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267584 00000100:00100000:2.0:1788927303.690657:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788927303.690664:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075267584:12345-0@lo:503: 00000100:00100000:2.0:1788927303.690756:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075267584:12345-0@lo:503: Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.690762:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788927303.692510:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267584:0@lo:503: 00000100:00100000:3.0:1788927303.694178:0:8842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8842:1875826075267712:0@lo:502: 00000100:00100000:3.0:1788927303.694295:0:8842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.694351:0:8842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.698293:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267712 00000100:00100000:2.0:1788927303.698316:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267712 00000100:00100000:2.0:1788927303.698401:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788927303.698415:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:8842:x1875826075267712:12345-0@lo:502: 00000100:00100000:2.0:1788927303.698713:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+14:8842:x1875826075267712:12345-0@lo:502: Request processed in 300us (4416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.698722:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788927303.699157:0:8842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b27480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8842:1875826075267712:0@lo:502: 00000020:01000000:0.0:1788927303.699209:0:8842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927303.699223:0:8842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927303.699235:0:8842:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788927303.699242:0:8842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788927303.699292:0:8842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8842:1875826075267840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927303.699356:0:8842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927303.699395:0:8842:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947bb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.699721:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267840 00000100:00100000:1.0:1788927303.699729:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267840 00000100:00100000:1.0:1788927303.699787:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788927303.699798:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8842:x1875826075267840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927303.699934:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:8842:x1875826075267840:12345-0@lo:502:llog_process_th.0 Request processed in 137us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.699942:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788927303.700265:0:8842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8842:1875826075267840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788927303.700293:0:8842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927303.700300:0:8842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927303.700302:0:8842:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788927303.700306:0:8842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788927303.700706:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788927303.700729:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788927303.700741:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e951a expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.700753:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc1800/0x750239bd504e9513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e951a expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927303.700764:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788927303.700767:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff918974bed000 from 39 10000000:01000000:1.0:1788927303.700771:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788927303.700816:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.700825:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.700837:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927303.700857:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.700902:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.700937:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788927303.701007:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075267968 00000100:00100000:0.0:1788927303.701013:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075267968 00000100:00100000:0.0:1788927303.701084:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788927303.701094:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+14:5951:x1875826075267968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927303.701114:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927303.701130:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc1e00/0x750239bd504e9528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9521 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.701156:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc1e00/0x750239bd504e9528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9521 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.701168:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc1e00/0x750239bd504e9528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9521 expref: 15 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.701179:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1e00, rc 0) 00000100:00100000:0.0:1788927303.701288:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075267968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927303.701296:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788927303.701364:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075267968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788927303.701380:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9528 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.701390:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9528 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927303.701461:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.701489:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.711882:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927303.712147:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268096 00000100:00100000:3.0:1788927303.712163:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268096 00000100:00100000:2.0:1788927303.712427:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788927303.712443:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075268096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.712741:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075268096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (11249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.712750:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788927303.712916:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.712984:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.713139:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.713203:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.713298:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268224 00000100:00100000:2.0:1788927303.713311:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268224 00000100:00100000:2.0:1788927303.713350:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788927303.713359:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075268224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.713504:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075268224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.713513:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788927303.713847:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.714434:0:8843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8843:1875826075268352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.714498:0:8843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.714577:0:8843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.714709:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268352 00000100:00100000:2.0:1788927303.714715:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268352 00000100:00100000:2.0:1788927303.714755:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788927303.714764:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:8843:x1875826075268352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.714922:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:8843:x1875826075268352:12345-0@lo:502:llog_process_th.0 Request processed in 158us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.714931:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788927303.715000:0:8843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8843:1875826075268352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.715513:0:8843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8843:1875826075268480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.715560:0:8843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.715635:0:8843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.715801:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268480 00000100:00100000:2.0:1788927303.715816:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268480 00000100:00100000:2.0:1788927303.715889:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788927303.715899:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:8843:x1875826075268480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.716007:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+15:8843:x1875826075268480:12345-0@lo:502:llog_process_th.0 Request processed in 108us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.716016:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788927303.716171:0:8843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8843:1875826075268480:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788927303.716430:0:8843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788927303.716696:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788927303.716727:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788927303.716740:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9528 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.716754:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951778a00/0x750239bd504e9521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9528 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927303.716765:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788927303.716769:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788927303.716772:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788927303.716817:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.716827:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.716837:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927303.716867:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.716914:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.716949:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268608 00000100:00100000:1.0:1788927303.716954:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268608 00000100:00100000:1.0:1788927303.716984:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788927303.716992:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+15:5951:x1875826075268608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788927303.717004:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927303.717020:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951779400/0x750239bd504e9536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e952f expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.717104:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951779400/0x750239bd504e9536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e952f expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.717117:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951779400/0x750239bd504e9536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e952f expref: 16 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.717127:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951779400, rc 0) 00000100:00100000:1.0:1788927303.717158:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075268608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.717165:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788927303.717204:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.717343:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788927303.717361:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9536 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927303.717371:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9536 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927303.717435:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.717463:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.717486:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268736 00000100:00100000:1.0:1788927303.717489:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268736 00000100:00100000:1.0:1788927303.717506:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788927303.717512:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075268736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.717669:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075268736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.717678:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788927303.717699:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.717710:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.717736:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.717776:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.717794:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268864 00000100:00100000:1.0:1788927303.717797:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268864 00000100:00100000:1.0:1788927303.717824:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788927303.717831:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075268864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.717924:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075268864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.717931:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788927303.717959:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.717971:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075268864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927303.720703:0:8844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8844:1875826075268992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927303.720826:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.720933:0:8844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42180 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.721156:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075268992 00000100:00100000:2.0:1788927303.721166:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075268992 00000100:00100000:2.0:1788927303.721340:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788927303.721353:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:8844:x1875826075268992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.721533:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:8844:x1875826075268992:12345-0@lo:502:llog_process_th.0 Request processed in 181us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.721551:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788927303.721697:0:8844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8844:1875826075268992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788927303.721738:0:8844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927303.721749:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927303.721752:0:8844:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788927303.721758:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788927303.721787:0:8844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8844:1875826075269120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927303.721836:0:8844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.721903:0:8844:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dc42180 going to sleep for 11 seconds 00000100:00100000:3.0:1788927303.722002:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269120 00000100:00100000:3.0:1788927303.722007:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269120 00000100:00100000:3.0:1788927303.722156:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788927303.722175:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:8844:x1875826075269120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.722395:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:8844:x1875826075269120:12345-0@lo:502:llog_process_th.0 Request processed in 222us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927303.722403:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788927303.722489:0:8844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8844:1875826075269120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788927303.722512:0:8844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927303.722517:0:8844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927303.722519:0:8844:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788927303.722523:0:8844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788927303.722803:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788927303.722975:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788927303.722988:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9536 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.723002:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951778600/0x750239bd504e952f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9536 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927303.723014:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788927303.723018:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91895033f000 from 39 10000000:01000000:2.0:1788927303.723022:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788927303.723371:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.723382:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.723394:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927303.723418:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.723477:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.723559:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918947b8ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927303.723714:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269248 00000100:00100000:3.0:1788927303.723722:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269248 00000100:00100000:2.0:1788927303.723889:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788927303.723899:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075269248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927303.723913:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927303.723929:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9188448c6200/0x750239bd504e9544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e953d expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.723973:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9188448c6200/0x750239bd504e9544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e953d expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.723984:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9188448c6200/0x750239bd504e9544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e953d expref: 17 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.723995:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c6200, rc 0) 00000100:00100000:2.0:1788927303.724183:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075269248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 284us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.724191:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788927303.724350:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788927303.724368:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9544 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927303.724379:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9544 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927303.724466:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.724501:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.724567:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe540 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.724716:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269376 00000100:00100000:2.0:1788927303.724722:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269376 00000100:00100000:2.0:1788927303.724784:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788927303.724792:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075269376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.724945:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075269376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.724953:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788927303.725018:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.725063:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.725116:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.725145:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe540 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.725323:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269504 00000100:00100000:2.0:1788927303.725332:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269504 00000100:00100000:2.0:1788927303.725353:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788927303.725360:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075269504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.725453:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075269504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.725460:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788927303.725536:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.726013:0:8845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8845:1875826075269632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.726136:0:8845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.726170:0:8845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.726216:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269632 00000100:00100000:2.0:1788927303.726221:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269632 00000100:00100000:2.0:1788927303.726325:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788927303.726332:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:8845:x1875826075269632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.726435:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:8845:x1875826075269632:12345-0@lo:502:llog_process_th.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.726444:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788927303.726523:0:8845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8845:1875826075269632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.726573:0:8845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8845:1875826075269760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.726642:0:8845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.726659:0:8845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.726701:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269760 00000100:00100000:2.0:1788927303.726706:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269760 00000100:00100000:2.0:1788927303.726725:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788927303.726731:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:8845:x1875826075269760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.726800:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:8845:x1875826075269760:12345-0@lo:502:llog_process_th.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.726817:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788927303.726884:0:8845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8845:1875826075269760:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788927303.726902:0:8845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788927303.727348:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788927303.727371:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788927303.727382:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9544 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727395:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9188448c7200/0x750239bd504e953d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9544 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927303.727405:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788927303.727408:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788927303.727411:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788927303.727442:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727451:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727476:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927303.727495:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.727536:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.727559:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.727577:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075269888 00000100:00100000:2.0:1788927303.727582:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075269888 00000100:00100000:2.0:1788927303.727629:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788927303.727637:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075269888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927303.727648:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927303.727661:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9188448c7000/0x750239bd504e9552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e954b expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727685:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9188448c7000/0x750239bd504e9552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e954b expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727698:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9188448c7000/0x750239bd504e9552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e954b expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727708:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c7000, rc 0) 00000100:00100000:2.0:1788927303.727740:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075269888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.727747:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788927303.727780:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075269888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927303.727793:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9552 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.727821:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9552 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927303.727880:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.727904:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.727916:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.727927:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270016 00000100:00100000:2.0:1788927303.727930:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270016 00000100:00100000:2.0:1788927303.727948:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788927303.727954:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075270016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.728341:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075270016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.728349:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788927303.728380:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.728414:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.728462:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.728494:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788927303.728509:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270144 00000100:00100000:2.0:1788927303.728513:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270144 00000100:00100000:2.0:1788927303.728679:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788927303.728688:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075270144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.728824:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075270144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.728831:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788927303.728907:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.729360:0:8846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8846:1875826075270272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927303.729407:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.737260:0:8846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe180 going to sleep for 11 seconds 00000100:00100000:1.0:1788927303.737413:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270272 00000100:00100000:1.0:1788927303.737427:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270272 00000100:00100000:1.0:1788927303.737496:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788927303.737508:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+18:8846:x1875826075270272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927303.737958:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+18:8846:x1875826075270272:12345-0@lo:502:llog_process_th.0 Request processed in 449us (8547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.737968:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788927303.742202:0:8846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8846:1875826075270272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788927303.742362:0:8846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788927303.742382:0:8846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788927303.742384:0:8846:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788927303.742392:0:8846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788927303.742456:0:8846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8846:1875826075270400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.742566:0:8846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.742645:0:8846:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927303.742786:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270400 00000100:00100000:3.0:1788927303.742795:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270400 00000100:00100000:3.0:1788927303.742868:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788927303.742880:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:8846:x1875826075270400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788927303.743144:0:8846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8846:1875826075270400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788927303.743171:0:8846:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788927303.743176:0:8846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788927303.743178:0:8846:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788927303.743182:0:8846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1788927303.743588:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:8846:x1875826075270400:12345-0@lo:502:llog_process_th.0 Request processed in 160us (472us total) trans 0 rc 0/0 00000020:01000000:2.0:1788927303.743693:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788927303.743721:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788927303.743734:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9552 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.743746:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9188448c7400/0x750239bd504e954b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9552 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927303.743759:0:5951:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788927303.743763:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9189491499b8 from 1 10000000:01000000:2.0:1788927303.743766:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788927303.743798:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.743815:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.743826:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927303.743856:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.743903:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.743942:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788927303.743952:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270528 00000100:00100000:0.0:1788927303.743960:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270528 00000100:00100000:3.0:1788927303.743988:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788927303.743995:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788927303.744008:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075270528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927303.744020:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927303.744038:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc0800/0x750239bd504e9560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9559 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.744066:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0800/0x750239bd504e9560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9559 expref: 19 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.744079:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc0800/0x750239bd504e9560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9559 expref: 19 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927303.744090:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0800, rc 0) 00000100:00100000:0.0:1788927303.744149:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075270528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927303.744156:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788927303.744224:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927303.744249:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9560 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.744260:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9560 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927303.744563:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788927303.744624:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.744642:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a54c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788927303.745135:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270656 00000100:00100000:3.0:1788927303.745143:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270656 00000100:00100000:3.0:1788927303.745201:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788927303.745211:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075270656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788927303.745529:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075270656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (933us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788927303.745538:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788927303.748060:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075270656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788927303.748141:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788927303.748155:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9560 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927303.748169:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9188448c7c00/0x750239bd504e9559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9560 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927303.770834:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075270784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927303.770938:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927303.771071:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270784 00000100:00100000:3.0:1788927303.771082:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270784 00000100:00100000:3.0:1788927303.771175:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788927303.771188:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075270784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788927303.771225:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788927303.771300:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075270784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927303.771308:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788927303.771429:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788927303.771545:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b25180 x1875826075270784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927303.771568:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075270784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927303.771717:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075271168:0@lo:400:kworker.0 00000100:00100000:2.0:1788927303.771774:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.771800:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927303.771819:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075271040:0@lo:400:kworker.0 00000100:00100000:2.0:1788927303.771844:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927303.771878:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271168 00000100:00100000:2.0:1788927303.771883:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271168 00000100:00100000:2.0:1788927303.771924:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271040 00000100:00100000:2.0:1788927303.771928:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271040 00000100:00100000:2.0:1788927303.771949:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788927303.771957:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075271168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927303.772000:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075271168:12345-0@lo:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.772006:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788927303.772020:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788927303.772026:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075271040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927303.772052:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075271040:12345-0@lo:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927303.772058:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788927303.772091:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927303.772109:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075271040:0@lo:400:kworker.0 00000100:00100000:2.0:1788927303.772119:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075271168:0@lo:400:kworker.0 00000100:00100000:1.0:1788927303.772191:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075270912:0@lo:400:kworker.0 00000100:00100000:1.0:1788927303.772225:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927303.772277:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075270912 00000100:00100000:1.0:1788927303.772280:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075270912 00000100:00100000:1.0:1788927303.772306:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788927303.772321:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075270912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927303.772359:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075270912:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927303.772366:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788927303.772396:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075270912:0@lo:400:kworker.0 00010000:00010000:2.0:1788927304.604401:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927305.627339:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927306.652571:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927307.268228:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927307.268302:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927307.268461:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223040 00000100:00100000:0.0:1788927307.268474:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223040 00000100:00100000:0.0:1788927307.268557:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223168 00000100:00100000:0.0:1788927307.268560:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223168 00000100:00100000:0.0:1788927307.268579:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 165 00000100:00100000:0.0:1788927307.268591:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053223040:12345-192.168.203.54@tcp:101: 00000100:00100000:1.0:1788927307.268650:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 166 00000100:00100000:1.0:1788927307.268665:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:2360:x1875826053223168:12345-192.168.203.54@tcp:400: 00010000:00010000:0.0:1788927307.268670:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927307.268707:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc0000/0x750239bd504e9567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db8fb expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927307.268744:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0000/0x750239bd504e9567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8fb expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927307.268755:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053223168:12345-192.168.203.54@tcp:400: Request processed in 93us (450us total) trans 0 rc 0/0 00010000:00010000:0.0:1788927307.268760:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc0000/0x750239bd504e9567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8fb expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927307.268767:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 166 00010000:00010000:0.0:1788927307.268780:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0000, rc 0) 00000100:00100000:0.0:1788927307.268829:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053223040:12345-192.168.203.54@tcp:101: Request processed in 239us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927307.268837:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 165 00000100:00100000:3.0:1788927307.269304:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927307.269435:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223424 00000100:00100000:0.0:1788927307.269441:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223424 00000100:00100000:0.0:1788927307.269525:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:0.0:1788927307.269534:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053223424:12345-192.168.203.54@tcp:400: 00000100:00080000:1.0:1788927307.269635:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788927307.278097:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053223424:12345-192.168.203.54@tcp:400: Request processed in 8539us (8769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927307.278120:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:3.0:1788927307.281884:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927307.282047:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927307.282098:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927307.282482:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223680 00000100:00100000:1.0:1788927307.282496:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223680 00000100:00100000:1.0:1788927307.282573:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 167 00000100:00100000:1.0:1788927307.282587:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053223680:12345-192.168.203.54@tcp:501: 00000100:00100000:1.0:1788927307.282890:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053223680:12345-192.168.203.54@tcp:501: Request processed in 305us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927307.282900:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 167 00000100:00100000:0.0:1788927307.284660:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223552 00000100:00100000:0.0:1788927307.284679:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223552 00000100:00100000:0.0:1788927307.284802:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:0.0:1788927307.284825:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053223552:12345-192.168.203.54@tcp:400: 00000100:00100000:0.0:1788927307.284921:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053223552:12345-192.168.203.54@tcp:400: Request processed in 108us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927307.284930:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00080000:1.0:1788927307.285279:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788927307.294544:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927307.295400:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223808 00000100:00100000:0.0:1788927307.295414:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223808 00000100:00100000:0.0:1788927307.295518:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 168 00000100:00100000:0.0:1788927307.295532:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053223808:12345-192.168.203.54@tcp:503: 00000100:00100000:1.0:1788927307.296109:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053223808:12345-192.168.203.54@tcp:503: Request processed in 576us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927307.296120:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 168 00000100:00100000:2.0:1788927307.297122:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223296 00000100:00100000:2.0:1788927307.297137:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223296 00000100:00100000:2.0:1788927307.297244:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:2.0:1788927307.297256:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053223296:12345-192.168.203.54@tcp:400: 00000100:00080000:1.0:1788927307.297408:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927307.306528:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053223296:12345-192.168.203.54@tcp:400: Request processed in 9253us (24638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927307.306550:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:3.0:1788927307.327483:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927307.327643:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053223936 00000100:00100000:0.0:1788927307.327658:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053223936 00000100:00100000:0.0:1788927307.327723:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 169 00000100:00100000:0.0:1788927307.327734:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5944:x1875826053223936:12345-192.168.203.54@tcp:502: 00000100:00100000:0.0:1788927307.327984:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5944:x1875826053223936:12345-192.168.203.54@tcp:502: Request processed in 250us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927307.327994:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 169 00000100:00100000:0.0:1788927307.335531:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927307.338077:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224064 00000100:00100000:1.0:1788927307.338106:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224064 00000100:00100000:1.0:1788927307.338235:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 170 00000100:00100000:1.0:1788927307.338249:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5944:x1875826053224064:12345-192.168.203.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788927307.338486:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5944:x1875826053224064:12345-192.168.203.54@tcp:502:llog_process_th.0 Request processed in 227us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927307.338497:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 170 00000100:00100000:2.0:1788927307.346930:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927307.347259:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224192 00000100:00100000:1.0:1788927307.347275:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224192 00000100:00100000:1.0:1788927307.347363:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 171 00000100:00100000:1.0:1788927307.347377:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053224192:12345-192.168.203.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788927307.347399:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927307.347422:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918951778200/0x750239bd504e956e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db902 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927307.347458:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918951778200/0x750239bd504e956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db902 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927307.347549:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918951778200/0x750239bd504e956e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db902 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927307.347563:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951778200, rc 0) 00000100:00100000:1.0:1788927307.347688:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224192:12345-192.168.203.54@tcp:101:ll_cfg_requeue.0 Request processed in 313us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927307.347777:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 171 00000100:00100000:2.0:1788927307.356956:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927307.357090:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224320 00000100:00100000:0.0:1788927307.357104:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224320 00000100:00100000:0.0:1788927307.357198:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 172 00000100:00100000:0.0:1788927307.357211:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224320:12345-192.168.203.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927307.357675:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224320:12345-192.168.203.54@tcp:501:ll_cfg_requeue.0 Request processed in 464us (732us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927307.357685:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 172 00010000:00010000:1.0:1788927307.674919:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927308.388218:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075271296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927308.388308:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.389727:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271296 00000100:00100000:2.0:1788927308.389754:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271296 00000100:00100000:2.0:1788927308.389855:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788927308.389868:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075271296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927308.389911:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1788927308.389912:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788927308.390007:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075271296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927308.390015:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788927308.390519:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484d500 x1875826075271296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927308.390545:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075271296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927308.704922:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927308.891235:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075271808:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.891335:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.891408:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788927308.891415:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075271424:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.891449:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.891476:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075271936:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.891501:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.891529:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075271680:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.891583:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.891630:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788927308.891636:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075271552:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.891660:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.891685:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075272064:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.891708:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927308.891891:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271424 00000100:00100000:2.0:1788927308.891900:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271424 00000100:00100000:2.0:1788927308.891961:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788927308.891972:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075271424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.892030:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075271424:12345-0@lo:400:kworker.0 Request processed in 60us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927308.892037:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788927308.892078:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271936 00000100:00100000:2.0:1788927308.892082:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271936 00000100:00100000:2.0:1788927308.892118:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271680 00000100:00100000:2.0:1788927308.892121:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271680 00000100:00100000:2.0:1788927308.892135:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271552 00000100:00100000:2.0:1788927308.892138:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271552 00000100:00100000:2.0:1788927308.892152:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788927308.892159:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.892193:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075271936:12345-0@lo:400:kworker.0 Request processed in 35us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927308.892199:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788927308.892210:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788927308.892216:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075271680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927308.893941:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075271808 00000100:00100000:0.0:1788927308.893958:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075271808 00000100:00100000:0.0:1788927308.894031:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272064 00000100:00100000:0.0:1788927308.894036:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272064 00000100:00100000:0.0:1788927308.894065:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788927308.894075:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075271808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927308.894172:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075271808:12345-0@lo:400:kworker.0 Request processed in 98us (2837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927308.894181:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788927308.894199:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788927308.894206:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075272064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927308.894959:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788927308.894975:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075271552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927308.895093:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927308.895112:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075272192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927308.895157:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927308.895208:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272192 00000100:00100000:3.0:1788927308.895213:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272192 00000100:00100000:3.0:1788927308.895244:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788927308.895250:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1875826075272192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788927308.895275:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788927308.895308:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1875826075272192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927308.895315:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788927308.895373:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b26680 x1875826075272192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927308.895394:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075272192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927308.899213:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075271680:12345-0@lo:400:kworker.0 Request processed in 6982us (7615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927308.899231:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788927308.899305:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788927308.899312:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927308.899360:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075271424:0@lo:400:kworker.0 00000100:00100000:2.0:1788927308.899407:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075271936:0@lo:400:kworker.0 00010000:00080000:2.0:1788927308.899425:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd39180 x1875826075271808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927308.899436:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075271808:0@lo:400:kworker.0 00000100:00100000:0.0:1788927308.899847:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075272064:12345-0@lo:400:kworker.0 Request processed in 5638us (8135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927308.899859:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788927308.906196:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075271552:12345-0@lo:400:kworker.0 Request processed in 11213us (14520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927308.906215:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788927308.906507:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075271552:0@lo:400:kworker.0 00010000:00080000:3.0:1788927308.906530:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd38700 x1875826075272064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927308.906542:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075272064:0@lo:400:kworker.0 00000100:00100000:3.0:1788927308.906557:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075271680:0@lo:400:kworker.0 00000020:00000080:0.0:1788927309.130921:0:8884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8d322a50 20000000:00000080:0.0:1788927309.130946:0:8884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91897dc3d400 uarg=0000000000000000 20000000:01000000:0.0:1788927309.131000:0:8884:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788927309.131006:0:8884:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788927309.131012:0:8884:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788927309.132397:0:8885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788927309.132581:0:8884:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788927309.145377:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788927309.145452:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788927309.145469:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788927309.145488:0:8884:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788927309.145514:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145536:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e92e3 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145545:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9345 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145552:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9410 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145564:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145573:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145647:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145663:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 9 pid: 5947 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927309.145680:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272320:192.168.203.54@tcp:104: 00010000:00010000:0.0:1788927309.145841:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9410 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145849:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9410 expref: 18 pid: 5947 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927309.145866:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272448:0@lo:104: 00000100:00100000:0.0:1788927309.145916:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927309.145966:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9345 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.145974:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9345 expref: 18 pid: 5949 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927309.145984:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272576:0@lo:104: 00000100:00100000:0.0:1788927309.146009:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927309.146037:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e92e3 expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.146046:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e92e3 expref: 18 pid: 5948 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927309.146054:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272704:0@lo:104: 00000100:00100000:0.0:1788927309.146073:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788927309.146167:0:5938:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788927309.146190:0:5938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927309.146206:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272448 00000100:00100000:2.0:1788927309.146214:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272448 00000100:00100000:2.0:1788927309.146261:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272576 00000100:00100000:2.0:1788927309.146265:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272576 00000100:00100000:2.0:1788927309.146275:0:5938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272704 00000100:00100000:2.0:1788927309.146278:0:5938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272704 00000100:00100000:2.0:1788927309.146294:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788927309.146306:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+5:8884:x1875826075272448:12345-0@lo:104: 00010000:00010000:2.0:1788927309.146322:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146394:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788927309.146401:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+5:8884:x1875826075272448:12345-0@lo:104: Request processed in 98us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927309.146409:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788927309.146432:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788927309.146440:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+4:8884:x1875826075272576:12345-0@lo:104: 00010000:00010000:2.0:1788927309.146448:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927309.146458:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272448:0@lo:104: 00010000:00010000:2.0:1788927309.146495:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788927309.146500:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272576:0@lo:104: 00000100:00100000:2.0:1788927309.146512:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+4:8884:x1875826075272576:12345-0@lo:104: Request processed in 72us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927309.146519:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788927309.146552:0:5938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788927309.146559:0:5938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:8884:x1875826075272704:12345-0@lo:104: 00010000:00010000:2.0:1788927309.146566:0:5938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146628:0:5938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788927309.146635:0:5938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3b70cda-d4d0-488a-a813-7f141061abda+3:8884:x1875826075272704:12345-0@lo:104: Request processed in 76us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927309.146641:0:5938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788927309.146647:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272704:0@lo:104: 00010000:00010000:2.0:1788927309.146663:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788927309.146670:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146679:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820df400 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927309.146684:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146824:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927309.146834:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927309.146841:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788927309.146881:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146898:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927309.146924:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146931:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9189820df400/0x750239bd504e9410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9417 expref: -99 pid: 8009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146947:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788927309.146950:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146956:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918940031e00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927309.146959:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146966:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927309.146973:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927309.146978:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788927309.146992:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.146999:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927309.147005:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147011:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918940031e00/0x750239bd504e9345 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e934c expref: -99 pid: 6934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147029:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788927309.147031:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147037:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918940031a00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:2.0:1788927309.147039:0:5942:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147046:0:5942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788927309.147054:0:5942:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927309.147059:0:5942:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788927309.147073:0:5942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147079:0:5942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788927309.147100:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147109:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918940031a00/0x750239bd504e92e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e92ea expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147176:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927309.147179:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927309.147181:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927309.147189:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927309.147209:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884491ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075272832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788927309.147249:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927309.147278:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788927309.147284:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884491fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075272960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788927309.147305:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927309.147334:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884491df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075273088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788927309.147357:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927309.147394:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272832 00000100:00100000:2.0:1788927309.147399:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272832 00010000:00010000:2.0:1788927309.147425:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9410 expref: 19 pid: 5947 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927309.147458:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075272960 00000100:00100000:2.0:1788927309.147461:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075272960 00010000:00010000:2.0:1788927309.147473:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9345 expref: 20 pid: 5949 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927309.147485:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273088 00000100:00100000:2.0:1788927309.147487:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273088 00010000:00010000:2.0:1788927309.147498:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e92e3 expref: 21 pid: 5948 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927309.147510:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788927309.147517:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+21:3445:x1875826075272832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788927309.147529:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927309.147535:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9410 expref: 21 pid: 5947 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147545:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9410 expref: 21 pid: 5947 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147570:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc1000/0x750239bd504e9417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9410 expref: 21 pid: 5947 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.147583:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927309.147640:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+20:3445:x1875826075272832:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927309.147647:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788927309.147660:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+20:3445:x1875826075272960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788927309.147668:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927309.147674:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9345 expref: 20 pid: 5949 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.147696:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9345 expref: 20 pid: 5949 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.147711:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918940030800/0x750239bd504e934c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9345 expref: 20 pid: 5949 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927309.147724:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927309.147766:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075272960:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927309.149893:0:8019:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788927309.149915:0:8019:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1788927309.149952:0:5940:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788927309.153049:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788927309.153119:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788927309.153141:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+18:3443:x1875826075273088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788927309.153179:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927309.153191:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e92e3 expref: 18 pid: 5948 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.153208:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e92e3 expref: 18 pid: 5948 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.153232:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189413c8e00/0x750239bd504e92ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e92e3 expref: 18 pid: 5948 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.153253:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927309.153358:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+17:3443:x1875826075273088:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (5999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927309.153365:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788927309.153427:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884491df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075273088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788927309.153609:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788927309.154253:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884491fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075272960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788927309.154279:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884491ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075272832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788927309.157831:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8884:1875826075272320:192.168.203.54@tcp:104: 00010000:00010000:1.0:1788927309.157870:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927309.167486:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927309.167633:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224448 00000100:00100000:3.0:1788927309.167643:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224448 00010000:00010000:3.0:1788927309.167682:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 10 pid: 5947 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927309.167724:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24 00000100:00100000:3.0:1788927309.167734:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053224448:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788927309.167750:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927309.167757:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 10 pid: 5947 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167783:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 10 pid: 5947 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167804:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189413c9400/0x750239bd504e94d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8ca expref: 10 pid: 5947 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167832:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167849:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167865:0:5939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167872:0:5939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167879:0:5939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167886:0:5939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167892:0:5939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1400 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:3.0:1788927309.167897:0:5939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167904:0:5939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167925:0:5939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927309.167936:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927309.167994:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:2360:x1875826053224448:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 260us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927309.168003:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24 00010000:00010000:1.0:1788927309.168197:0:8884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927309.168207:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927309.168215:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc1400/0x750239bd504e9575 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927309.724120:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788927310.751550:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788927310.751571:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9188410d4800 from 4 10000000:01000000:2.0:1788927310.751575:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788927310.751638:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927310.751649:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927310.751660:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927310.751686:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884491dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788927310.751750:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927310.751805:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91894336d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788927310.754265:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273216 00000100:00100000:2.0:1788927310.754274:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273216 00000100:00100000:2.0:1788927310.754331:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788927310.754340:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075273216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927310.754356:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927310.754374:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e957c expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927310.754401:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e957c expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927310.754413:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e957c expref: 17 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927310.754588:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927310.756091:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c7600, rc 0) 00000100:00100000:2.0:1788927310.756185:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075273216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1842us (4431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927310.756204:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788927310.756360:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884491dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788927310.756391:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927310.756404:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927310.756484:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788927310.756521:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927310.756645:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dcf73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927310.765401:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273344 00000100:00100000:1.0:1788927310.765415:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273344 00000100:00100000:3.0:1788927310.765686:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788927310.765697:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075273344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788927310.765866:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075273344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (9343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927310.765874:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788927310.766087:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b26680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927310.766145:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927310.766189:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927310.766228:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.766364:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273472 00000100:00100000:0.0:1788927310.766370:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273472 00000100:00100000:0.0:1788927310.766403:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788927310.766411:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075273472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.766493:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075273472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.766500:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788927310.766886:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.767249:0:8938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8938:1875826075273600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.767435:0:8938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.767507:0:8938:0:(client.c:2715:ptlrpc_set_wait()) set ffff9188438fe180 going to sleep for 11 seconds 00000100:00100000:1.0:1788927310.772996:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273600 00000100:00100000:1.0:1788927310.773013:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273600 00000100:00100000:3.0:1788927310.779011:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788927310.779028:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:8938:x1875826075273600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788927310.779192:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:8938:x1875826075273600:12345-0@lo:502:llog_process_th.0 Request processed in 168us (11755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927310.779200:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788927310.781018:0:8938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8938:1875826075273600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788927310.781067:0:8938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788927310.781078:0:8938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927310.781080:0:8938:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788927310.781087:0:8938:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9188410d4800 00000020:00000080:1.0:1788927310.781090:0:8938:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788927310.781202:0:8938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8938:1875826075273728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927310.781265:0:8938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927310.781307:0:8938:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd333c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788927310.782331:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273728 00000100:00100000:1.0:1788927310.782341:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273728 00000100:00100000:1.0:1788927310.782386:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788927310.782394:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:8938:x1875826075273728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927310.782525:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:8938:x1875826075273728:12345-0@lo:502:llog_process_th.0 Request processed in 131us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927310.782542:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788927310.782622:0:8938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8938:1875826075273728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788927310.782647:0:8938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788927310.782654:0:8938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788927310.782656:0:8938:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788927310.782659:0:8938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788927310.782719:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788927310.782735:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788927310.782744:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927310.782755:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788927310.782777:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788927310.782779:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff918974bed000 from 4 10000000:01000000:1.0:1788927310.782782:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788927310.782806:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927310.782814:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927310.782823:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927310.782838:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788927310.782868:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927310.782892:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd333c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788927310.785051:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273856 00000100:00100000:3.0:1788927310.785064:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273856 00000100:00100000:3.0:1788927310.785124:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788927310.785133:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075273856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788927310.785148:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927310.785167:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e958a expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927310.785212:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927310.785223:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927310.785231:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df200, rc 0) 00000100:00100000:3.0:1788927310.785299:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075273856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927310.785306:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788927310.788690:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927310.788716:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.788728:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927310.788830:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.788887:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.788923:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.788944:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075273984 00000100:00100000:0.0:1788927310.788949:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075273984 00000100:00100000:0.0:1788927310.788991:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788927310.789000:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075273984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.789127:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075273984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.789135:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788927310.789167:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075273984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.789190:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.789223:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.789234:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.789246:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274112 00000100:00100000:0.0:1788927310.789249:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274112 00000100:00100000:0.0:1788927310.789276:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788927310.789281:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075274112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.789352:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075274112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.789358:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788927310.789398:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.789568:0:8941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8941:1875826075274240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.789628:0:8941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.789646:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274240 00000100:00100000:0.0:1788927310.789649:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274240 00000100:00100000:0.0:1788927310.789670:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788927310.789675:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:8941:x1875826075274240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.789738:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:8941:x1875826075274240:12345-0@lo:502:llog_process_th.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.789744:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788927310.789784:0:8941:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.789796:0:8941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8941:1875826075274240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788927310.789816:0:8941:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927310.789824:0:8941:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927310.789827:0:8941:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788927310.789832:0:8941:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff918974bed000 00000020:00000080:0.0:1788927310.789834:0:8941:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788927310.789895:0:8941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8941:1875826075274368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.789926:0:8941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.789944:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274368 00000100:00100000:0.0:1788927310.789948:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274368 00000100:00100000:0.0:1788927310.789968:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788927310.789973:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:8941:x1875826075274368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.790028:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:8941:x1875826075274368:12345-0@lo:502:llog_process_th.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.790034:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788927310.790061:0:8941:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.790071:0:8941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8941:1875826075274368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788927310.790095:0:8941:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927310.790099:0:8941:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927310.790100:0:8941:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788927310.790103:0:8941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788927310.790148:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788927310.790163:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788927310.790171:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790180:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927310.790188:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788927310.790190:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91895033f000 from 4 10000000:01000000:0.0:1788927310.790193:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788927310.790214:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790221:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790229:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927310.790240:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.790264:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.790276:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff91896f17e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.790287:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274496 00000100:00100000:0.0:1788927310.790291:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274496 00000100:00100000:0.0:1788927310.790311:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788927310.790317:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075274496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927310.790332:0:5949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927310.790345:0:5949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e9598 expref: -99 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790363:0:5949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e9598 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790372:0:5949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9598 expref: 19 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790381:0:5949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1c00, rc 0) 00000100:00100000:0.0:1788927310.790410:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075274496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.790416:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788927310.790445:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927310.790455:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.790463:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927310.790498:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.790521:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.790533:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.790544:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274624 00000100:00100000:0.0:1788927310.790547:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274624 00000100:00100000:0.0:1788927310.790566:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788927310.790571:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075274624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.790668:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075274624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.790675:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788927310.795892:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.795951:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.796103:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.799493:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918974a52a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788927310.810746:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274752 00000100:00100000:1.0:1788927310.810776:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274752 00000100:00100000:1.0:1788927310.815723:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788927310.815738:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075274752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927310.815925:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075274752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (19820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927310.815933:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788927310.816995:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075274752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927310.820159:0:8944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8944:1875826075274880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.820241:0:8944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.820280:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075274880 00000100:00100000:0.0:1788927310.820287:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075274880 00000100:00100000:0.0:1788927310.820326:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788927310.820335:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:8944:x1875826075274880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.820441:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:8944:x1875826075274880:12345-0@lo:502:llog_process_th.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927310.820449:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788927310.820497:0:8944:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788927310.820516:0:8944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8944:1875826075274880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788927310.820544:0:8944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788927310.820554:0:8944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927310.820556:0:8944:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788927310.820562:0:8944:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91895033f000 00000020:00000080:0.0:1788927310.820564:0:8944:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788927310.820664:0:8944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8944:1875826075275008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788927310.820696:0:8944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927310.820709:0:8944:0:(client.c:2715:ptlrpc_set_wait()) set ffff91897dd2c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788927310.820819:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275008 00000100:00100000:1.0:1788927310.820824:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275008 00000100:00100000:1.0:1788927310.820855:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788927310.820863:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:8944:x1875826075275008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788927310.820932:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:8944:x1875826075275008:12345-0@lo:502:llog_process_th.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927310.820940:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788927310.821409:0:8944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3b70cda-d4d0-488a-a813-7f141061abda:8944:1875826075275008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788927310.821434:0:8944:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788927310.821440:0:8944:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788927310.821442:0:8944:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788927310.821445:0:8944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788927310.821499:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788927310.821517:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788927310.821525:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927310.821537:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927311.048734:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927311.050340:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224576 00000100:00100000:3.0:1788927311.050353:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224576 00000100:00100000:3.0:1788927311.050408:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 189 00000100:00100000:3.0:1788927311.050419:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053224576:12345-192.168.203.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788927311.050435:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927311.051110:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db909 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927311.051145:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927311.051158:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 10 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927311.051168:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de000, rc 0) 00000100:00100000:3.0:1788927311.051227:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224576:12345-192.168.203.54@tcp:101:ll_cfg_requeue.0 Request processed in 809us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927311.051775:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 189 00000100:00100000:0.0:1788927311.057556:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927311.062771:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224704 00000100:00100000:1.0:1788927311.062786:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224704 00000100:00100000:1.0:1788927311.063752:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 190 00000100:00100000:1.0:1788927311.063774:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224704:12345-192.168.203.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927311.064079:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224704:12345-192.168.203.54@tcp:501:ll_cfg_requeue.0 Request processed in 306us (6531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927311.064088:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 190 00000100:00100000:1.0:1788927311.077690:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927311.077781:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224832 00000100:00100000:3.0:1788927311.077791:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224832 00000100:00100000:3.0:1788927311.077836:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 191 00000100:00100000:3.0:1788927311.077846:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224832:12345-192.168.203.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788927311.078004:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053224832:12345-192.168.203.54@tcp:503:ll_cfg_requeue.0 Request processed in 158us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927311.078023:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 191 00000100:00100000:0.0:1788927311.087801:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927311.088277:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053224960 00000100:00100000:3.0:1788927311.088287:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053224960 00000100:00100000:3.0:1788927311.088347:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 192 00000100:00100000:3.0:1788927311.088358:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:6007:x1875826053224960:12345-192.168.203.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788927311.088519:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:6007:x1875826053224960:12345-192.168.203.54@tcp:502:llog_process_th.0 Request processed in 161us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927311.088526:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 192 00000100:00100000:3.0:1788927311.104772:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927311.104870:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225088 00000100:00100000:1.0:1788927311.104889:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225088 00000100:00100000:1.0:1788927311.104955:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 193 00000100:00100000:1.0:1788927311.104966:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:6007:x1875826053225088:12345-192.168.203.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788927311.105151:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:6007:x1875826053225088:12345-192.168.203.54@tcp:502:llog_process_th.0 Request processed in 186us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927311.105160:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 193 00010000:00010000:1.0:1788927311.779807:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927312.394764:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927312.394810:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927312.394847:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927312.394939:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225472 00000100:00100000:0.0:1788927312.394948:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225472 00000100:00100000:0.0:1788927312.395009:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:0.0:1788927312.395019:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053225472:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927312.395080:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053225472:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927312.395088:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00080000:0.0:1788927312.395123:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788927312.395827:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927312.396417:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225216 00000100:00100000:1.0:1788927312.396435:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225216 00000100:00100000:1.0:1788927312.396482:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 194 00000100:00100000:1.0:1788927312.396499:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053225216:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927312.396546:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053225216:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 55us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927312.396553:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 194 00000100:00100000:1.0:1788927312.396581:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225600 00000100:00100000:1.0:1788927312.396585:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225600 00000100:00100000:1.0:1788927312.396642:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:1.0:1788927312.396649:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053225600:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927312.396674:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053225600:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 26us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927312.396680:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00080000:1.0:1788927312.396782:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788927312.403858:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225344 00000100:00100000:3.0:1788927312.403883:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225344 00000100:00100000:3.0:1788927312.403981:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 38 00000100:00100000:3.0:1788927312.403992:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053225344:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927312.404069:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053225344:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 78us (9220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927312.404077:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 38 00000100:00080000:1.0:1788927312.405966:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788927312.797202:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927313.500834:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927313.500864:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075275136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927313.500940:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927313.501010:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275136 00000100:00100000:2.0:1788927313.501018:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275136 00000100:00100000:2.0:1788927313.501075:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927313.501085:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075275136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927313.501115:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927313.501159:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075275136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927313.501166:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788927313.501206:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484df80 x1875826075275136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927313.501226:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075275136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788927313.501226:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788927313.822424:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927314.011490:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075275392:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.011573:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927314.011641:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075275904:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.011668:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927314.011697:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788927314.011704:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075275264:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.011730:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927314.011762:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075275776:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.011784:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927314.011810:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075275520:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.011830:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927314.011846:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927314.011850:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075275648:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.011869:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927314.011970:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275264 00000100:00100000:3.0:1788927314.011977:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275264 00000100:00100000:3.0:1788927314.012038:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788927314.012048:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075275264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012100:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075275264:12345-0@lo:400:kworker.0 Request processed in 52us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927314.012108:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788927314.012140:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275392 00000100:00100000:3.0:1788927314.012144:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275392 00000100:00100000:3.0:1788927314.012178:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275776 00000100:00100000:3.0:1788927314.012181:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275776 00000100:00100000:3.0:1788927314.012203:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275520 00000100:00100000:3.0:1788927314.012205:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275520 00000100:00100000:3.0:1788927314.012220:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788927314.012235:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075275392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012267:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075275392:12345-0@lo:400:kworker.0 Request processed in 34us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927314.012273:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788927314.012286:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788927314.012292:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075275776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012318:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075275776:12345-0@lo:400:kworker.0 Request processed in 27us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927314.012323:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788927314.012334:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788927314.012340:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075275520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012371:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075275520:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927314.012377:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788927314.012529:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075275520:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012552:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075275264:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012561:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075275776:0@lo:400:kworker.0 00000100:00100000:3.0:1788927314.012569:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075275392:0@lo:400:kworker.0 00000100:00100000:1.0:1788927314.020540:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275904 00000100:00100000:1.0:1788927314.020550:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275904 00000100:00100000:1.0:1788927314.020619:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075275648 00000100:00100000:1.0:1788927314.020623:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075275648 00000100:00100000:1.0:1788927314.020642:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788927314.020664:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075275904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927314.020757:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075275904:12345-0@lo:400:kworker.0 Request processed in 95us (9087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927314.020766:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788927314.020784:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788927314.020790:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075275648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927314.020818:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075275648:12345-0@lo:400:kworker.0 Request processed in 29us (8948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927314.020824:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788927314.020852:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788927314.020856:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927314.020863:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788927314.020877:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075276032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927314.020916:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788927314.020974:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b24000 x1875826075275904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927314.021001:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075275904:0@lo:400:kworker.0 00000100:00100000:1.0:1788927314.021024:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276032 00000100:00100000:1.0:1788927314.021028:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276032 00000100:00100000:1.0:1788927314.021052:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788927314.021059:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075276032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788927314.021080:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927314.021117:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075276032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927314.021124:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788927314.021252:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b24700 x1875826075275648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927314.021263:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075275648:0@lo:400:kworker.0 00010000:00080000:1.0:1788927314.021461:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484dc00 x1875826075276032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927314.021482:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075276032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788927314.844128:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927315.874117:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927316.895049:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927316.969550:0:9182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788927317.542130:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927317.542184:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927317.542219:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927317.542261:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927317.542404:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225984 00000100:00100000:0.0:1788927317.542436:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225984 00000100:00100000:0.0:1788927317.542520:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226112 00000100:00100000:0.0:1788927317.542524:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226112 00000100:00100000:0.0:1788927317.542546:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:0.0:1788927317.542557:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2359:x1875826053225984:12345-192.168.203.54@tcp:9:kworker.0 00000020:00000080:0.0:1788927317.542655:0:6942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x750239bd504e94e2 00000100:00080000:0.0:1788927317.542669:0:6942:0:(import.c:65:import_set_state_nolock()) ffff918842fb3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788927317.542738:0:6942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788927317.542955:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+2:2359:x1875826053225984:12345-192.168.203.54@tcp:9:kworker.0 Request processed in 399us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927317.542964:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:0.0:1788927317.542984:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:0.0:1788927317.542992:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2359:x1875826053226112:12345-192.168.203.54@tcp:9:kworker.0 00000020:00000080:0.0:1788927317.543020:0:6942:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x750239bd504e94e9 00000100:00080000:0.0:1788927317.543028:0:6942:0:(import.c:65:import_set_state_nolock()) ffff918842fb0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788927317.543053:0:6942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788927317.543134:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+2:2359:x1875826053226112:12345-192.168.203.54@tcp:9:kworker.0 Request processed in 142us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927317.543141:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00010000:00010000:0.0:1788927317.543228:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927317.543370:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788927317.543631:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788927317.543636:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788927317.543832:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225856 00000100:00100000:3.0:1788927317.543845:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225856 00000100:00100000:3.0:1788927317.543905:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 42 00000100:00100000:3.0:1788927317.543914:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053225856:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927317.543962:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053225856:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 50us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927317.543970:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 42 00000100:00080000:2.0:1788927317.544125:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927317.544215:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053225728 00000100:00100000:1.0:1788927317.544221:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053225728 00000100:00100000:1.0:1788927317.544262:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 196 00000100:00100000:1.0:1788927317.544270:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053225728:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927317.544300:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053225728:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 31us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927317.544306:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 196 00010000:00010000:0.0:1788927317.914780:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927318.624766:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927318.624802:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884491dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075276160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927318.624895:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927318.624981:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276160 00000100:00100000:2.0:1788927318.624990:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276160 00000100:00100000:2.0:1788927318.625057:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788927318.625067:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075276160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927318.625107:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927318.625160:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075276160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927318.625168:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788927318.625194:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788927318.625245:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884491dc00 x1875826075276160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927318.625269:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884491dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075276160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927318.941073:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927319.131208:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075276672:0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.131317:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927319.131334:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075276416:0@lo:400:kworker.0 00000100:00100000:0.0:1788927319.131371:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927319.131390:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075276928:0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.131400:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927319.131406:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075276544:0@lo:400:kworker.0 00000100:00100000:0.0:1788927319.131423:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927319.131427:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927319.131461:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276416 00000100:00100000:0.0:1788927319.131464:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788927319.131469:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075276288:0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.131470:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276416 00000100:00100000:0.0:1788927319.131501:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927319.131522:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276544 00000100:00100000:0.0:1788927319.131522:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075276800:0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.131525:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276544 00000100:00100000:0.0:1788927319.131543:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927319.136760:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276672 00000100:00100000:1.0:1788927319.136782:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276672 00000100:00100000:1.0:1788927319.136850:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276928 00000100:00100000:1.0:1788927319.136854:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276928 00000100:00100000:1.0:1788927319.136883:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788927319.136895:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075276672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927319.137019:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075276672:12345-0@lo:400:kworker.0 Request processed in 125us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927319.137027:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788927319.137048:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788927319.137055:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075276928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927319.137088:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075276928:12345-0@lo:400:kworker.0 Request processed in 34us (5663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927319.137094:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788927319.137147:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276288 00000100:00100000:1.0:1788927319.137152:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276288 00000100:00100000:1.0:1788927319.137181:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788927319.137188:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075276288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927319.137224:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075276288:12345-0@lo:400:kworker.0 Request processed in 36us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927319.137230:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:0.0:1788927319.143843:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b24000 x1875826075276928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927319.143868:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075276928:0@lo:400:kworker.0 00000100:00100000:0.0:1788927319.143907:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075276288:0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.145976:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075276800 00000100:00100000:3.0:1788927319.145995:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075276800 00000100:00100000:3.0:1788927319.146092:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788927319.146105:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075276416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.146376:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075276416:12345-0@lo:400:kworker.0 Request processed in 272us (15003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927319.146385:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788927319.146504:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788927319.146515:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075276544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.146552:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075276544:12345-0@lo:400:kworker.0 Request processed in 40us (15124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927319.146559:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788927319.146621:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788927319.146629:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075276800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.146662:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075276800:12345-0@lo:400:kworker.0 Request processed in 35us (15119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927319.146668:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788927319.146741:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075276544:0@lo:400:kworker.0 00010000:00080000:3.0:1788927319.146761:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b25500 x1875826075276672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927319.146772:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075276672:0@lo:400:kworker.0 00000100:00100000:3.0:1788927319.146796:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927319.146807:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075277056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927319.146847:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927319.146895:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277056 00000100:00100000:3.0:1788927319.146900:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277056 00000100:00100000:3.0:1788927319.146935:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788927319.146941:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075277056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788927319.146969:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788927319.147009:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075277056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927319.147015:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788927319.147040:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484dc00 x1875826075277056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927319.147056:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075277056:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788927319.147097:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788927319.147104:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927319.147782:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075276800:0@lo:400:kworker.0 00000100:00100000:0.0:1788927319.147798:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075276416:0@lo:400:kworker.0 00010000:00010000:0.0:1788927319.963996:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927320.990414:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927322.017164:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927322.628344:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927322.628409:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927322.628496:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226240 00000100:00100000:0.0:1788927322.628509:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226240 00000100:00100000:0.0:1788927322.628592:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 198 00000100:00100000:0.0:1788927322.628622:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053226240:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927322.628739:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053226240:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927322.628749:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 198 00000100:00100000:1.0:1788927322.628888:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226368 00000100:00100000:1.0:1788927322.628893:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226368 00000100:00100000:1.0:1788927322.628961:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 46 00000100:00100000:1.0:1788927322.628970:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053226368:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927322.629022:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053226368:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 53us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927322.629030:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 46 00000100:00080000:0.0:1788927322.629139:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788927322.728920:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000020:00000080:1.0:1788927322.728934:0:6935:0:(genops.c:885:class_export_put()) final put ffff918842fa3800/20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000020:00000080:1.0:1788927322.728973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff918842fa3800/20893ea2-62f1-4ff2-a5ab-c8ef32fae354 for lustre-OST0000 00000020:00000080:1.0:1788927322.729039:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff918842fb3800 for lustre-OST0000 00000001:00100000:3.0:1788927322.733672:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000020:00000080:3.0:1788927322.733695:0:8011:0:(genops.c:885:class_export_put()) final put ffff918842fb6800/20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000020:00000080:1.0:1788927322.733846:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff918842fb6800/20893ea2-62f1-4ff2-a5ab-c8ef32fae354 for lustre-OST0001 00000020:00000080:1.0:1788927322.733907:0:469:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff918842fb0000 for lustre-OST0001 00010000:00010000:0.0:1788927323.041539:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927323.217311:0:9427:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing yml_node 00000100:00100000:2.0:1788927323.748061:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075277184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927323.748130:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927323.748208:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277184 00000100:00100000:2.0:1788927323.748215:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277184 00000100:00100000:2.0:1788927323.748264:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788927323.748273:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075277184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927323.748301:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:0.0:1788927323.748336:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788927323.748350:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075277184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927323.748378:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788927323.749266:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd2b800 x1875826075277184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927323.749287:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075277184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927324.059048:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927324.251744:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075277312:0@lo:400:kworker.0 00000100:00100000:1.0:1788927324.251821:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075277440:0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.251827:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927324.251866:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927324.251884:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075277824:0@lo:400:kworker.0 00000100:00100000:1.0:1788927324.251884:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075277952:0@lo:400:kworker.0 00000100:00100000:1.0:1788927324.251906:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927324.251918:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927324.251941:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277952 00000100:00100000:2.0:1788927324.251944:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075277568:0@lo:400:kworker.0 00000100:00100000:1.0:1788927324.251947:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277952 00000100:00100000:2.0:1788927324.251967:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927324.251982:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075278080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927324.252001:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927324.252003:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788927324.252012:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075277952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252015:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927324.252019:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075277696:0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252037:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927324.252056:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075277952:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927324.252063:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277312 00000100:00100000:1.0:1788927324.252063:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788927324.252067:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277312 00000100:00100000:1.0:1788927324.252077:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277696 00000100:00100000:1.0:1788927324.252079:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277696 00000100:00100000:1.0:1788927324.252091:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927324.252092:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788927324.252096:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075277696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252097:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075277312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252127:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075277312:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927324.252127:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075277696:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927324.252134:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788927324.252134:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788927324.252157:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277440 00000100:00100000:2.0:1788927324.252160:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277440 00010000:00080000:1.0:1788927324.252168:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd39880 x1875826075277952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927324.252181:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277824 00000100:00100000:1.0:1788927324.252181:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075277952:0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252183:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277824 00000100:00100000:2.0:1788927324.252194:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075277568 00000100:00100000:2.0:1788927324.252197:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075277568 00000100:00080000:1.0:1788927324.252208:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788927324.252213:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788927324.252214:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927324.252223:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788927324.252237:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075277440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252285:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075277440:12345-0@lo:400:kworker.0 Request processed in 48us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927324.252291:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788927324.252303:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788927324.252310:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075277824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252337:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075277824:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927324.252342:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788927324.252353:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788927324.252359:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075277568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252384:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075277568:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927324.252389:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788927324.252413:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278080 00000100:00100000:2.0:1788927324.252417:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278080 00000100:00100000:2.0:1788927324.252442:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788927324.252448:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075278080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927324.252468:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927324.252498:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075278080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927324.252504:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788927324.252551:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd39180 x1875826075277696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927324.252561:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075277696:0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252582:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075277568:0@lo:400:kworker.0 00010000:00080000:2.0:1788927324.252592:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484c700 x1875826075278080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927324.252627:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075278080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927324.252655:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075277312:0@lo:400:kworker.0 00000100:00100000:2.0:1788927324.252665:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075277824:0@lo:400:kworker.0 00000100:00100000:1.0:1788927324.253104:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075277440:0@lo:400:kworker.0 00010000:00010000:0.0:1788927325.082849:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927326.107623:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927327.130965:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927327.752701:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927327.752751:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927327.752876:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226496 00000100:00100000:3.0:1788927327.752886:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226496 00000100:00100000:3.0:1788927327.752946:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 200 00000100:00100000:3.0:1788927327.752957:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053226496:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927327.752995:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226624 00000100:00100000:1.0:1788927327.752999:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226624 00000100:00100000:3.0:1788927327.753028:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053226496:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 73us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927327.753036:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 200 00000100:00100000:1.0:1788927327.753040:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 50 00000100:00100000:1.0:1788927327.753046:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053226624:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927327.753077:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053226624:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927327.753084:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 50 00000100:00080000:1.0:1788927327.753109:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788927328.155923:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927328.230238:0:9610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.56 00000100:00100000:0.0:1788927328.866705:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075278208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788927328.866775:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927328.866858:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278208 00000100:00100000:0.0:1788927328.866865:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278208 00000100:00100000:0.0:1788927328.866922:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788927328.866932:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075278208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927328.866960:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927328.867002:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075278208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927328.867009:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788927328.867032:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788927328.867058:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd29880 x1875826075278208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927328.867075:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075278208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927329.183699:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927329.370770:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788927329.370791:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075278336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927329.370849:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927329.370914:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278336 00000100:00100000:2.0:1788927329.370920:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278336 00000100:00100000:2.0:1788927329.370967:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788927329.370975:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075278336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927329.371000:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927329.371035:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075278336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927329.371041:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788927329.371074:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449a8e00 x1875826075278336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927329.371092:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075278336:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788927329.372457:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788927329.372474:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075278592:0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.372517:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927329.372545:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927329.372550:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075278720:0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.372566:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927329.372591:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278592 00000100:00100000:0.0:1788927329.372612:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278592 00000100:00100000:0.0:1788927329.372652:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278720 00000100:00100000:0.0:1788927329.372660:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278720 00000100:00100000:0.0:1788927329.372685:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788927329.372692:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075278592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.372731:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075278592:12345-0@lo:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927329.372738:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788927329.372749:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788927329.372755:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075278720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.372773:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075278720:12345-0@lo:400:kworker.0 Request processed in 19us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927329.372778:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788927329.372794:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927329.372814:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075278720:0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.372822:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075278592:0@lo:400:kworker.0 00000100:00100000:1.0:1788927329.372880:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075278848:0@lo:400:kworker.0 00000100:00100000:1.0:1788927329.372922:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927329.372945:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788927329.372949:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075278464:0@lo:400:kworker.0 00000100:00100000:1.0:1788927329.372971:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927329.372993:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075278976:0@lo:400:kworker.0 00000100:00100000:1.0:1788927329.373009:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927329.373028:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278464 00000100:00100000:1.0:1788927329.373031:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278464 00000100:00100000:1.0:1788927329.373055:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788927329.373061:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075278464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927329.373087:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075278464:12345-0@lo:400:kworker.0 Request processed in 27us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927329.373094:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788927329.373124:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075278464:0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.373537:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278848 00000100:00100000:0.0:1788927329.373541:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278848 00000100:00100000:0.0:1788927329.373574:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788927329.373580:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075278848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.373641:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075278848:12345-0@lo:400:kworker.0 Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927329.373647:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788927329.373666:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075278976 00000100:00100000:0.0:1788927329.373670:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075278976 00000100:00100000:0.0:1788927329.373695:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788927329.373700:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075278976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927329.373727:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075278976:12345-0@lo:400:kworker.0 Request processed in 27us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927329.373741:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788927329.373756:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927329.373866:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075278976:0@lo:400:kworker.0 00010000:00080000:1.0:1788927329.373880:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd29f80 x1875826075278848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927329.373890:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075278848:0@lo:400:kworker.0 00010000:00010000:0.0:1788927330.209915:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788927331.216983:0:9709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.56 00010000:00010000:0.0:1788927331.228963:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927332.255751:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927332.870260:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927332.870341:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927332.870582:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226752 00000100:00100000:1.0:1788927332.870638:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226752 00000100:00100000:1.0:1788927332.870712:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 202 00000100:00100000:1.0:1788927332.870724:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053226752:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927332.870838:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053226752:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 115us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927332.870848:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 202 00000100:00100000:0.0:1788927332.872387:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053226880 00000100:00100000:0.0:1788927332.872402:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053226880 00000100:00100000:0.0:1788927332.872503:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 54 00000100:00100000:0.0:1788927332.872515:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053226880:12345-192.168.203.54@tcp:400:kworker.0 00000100:00080000:2.0:1788927332.872541:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927332.872641:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053226880:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 128us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927332.872650:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 54 00010000:00010000:0.0:1788927333.274905:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788927333.908946:0:9806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.56 00000100:00100000:1.0:1788927333.993630:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788927333.993666:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075279104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927333.993778:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927333.994692:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279104 00000100:00100000:2.0:1788927333.994706:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279104 00000100:00100000:2.0:1788927333.994792:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788927333.994805:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075279104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927333.994843:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927333.994911:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075279104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927333.994919:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788927333.995062:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788927333.995103:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449ab100 x1875826075279104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927333.995126:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075279104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927334.298861:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927334.491140:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075279232:0@lo:400:kworker.0 00000100:00100000:2.0:1788927334.491229:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075279488:0@lo:400:kworker.0 00000100:00100000:1.0:1788927334.491256:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927334.491268:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927334.491328:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075279360:0@lo:400:kworker.0 00000100:00100000:0.0:1788927334.491387:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075279616:0@lo:400:kworker.0 00000100:00100000:1.0:1788927334.491462:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075279744:0@lo:400:kworker.0 00000100:00100000:2.0:1788927334.496849:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788927334.496870:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075279872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927334.496973:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927334.497104:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927334.497164:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279488 00000100:00100000:2.0:1788927334.497167:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279872 00000100:00100000:3.0:1788927334.497174:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279488 00000100:00100000:2.0:1788927334.497174:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279872 00000100:00100000:2.0:1788927334.497250:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788927334.497262:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075279872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927334.497301:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927334.497358:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075279872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927334.497367:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788927334.497394:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279360 00000100:00100000:2.0:1788927334.497397:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279360 00000100:00100000:2.0:1788927334.497429:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788927334.497436:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075279360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927334.498155:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075279360:12345-0@lo:400:kworker.0 Request processed in 716us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927334.498165:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788927334.498227:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449ab800 x1875826075279872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927334.498250:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075279872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927334.498297:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075279360:0@lo:400:kworker.0 00000100:00100000:2.0:1788927334.498334:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279232 00000100:00100000:2.0:1788927334.498338:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279232 00000100:00100000:2.0:1788927334.498373:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788927334.498380:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075279232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927334.498423:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075279232:12345-0@lo:400:kworker.0 Request processed in 44us (7167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927334.498429:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788927334.499729:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927334.499783:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279616 00000100:00100000:0.0:1788927334.499791:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279616 00000100:00080000:2.0:1788927334.506754:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788927334.506768:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788927334.508567:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788927334.508632:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075279488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927334.508787:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075279488:12345-0@lo:400:kworker.0 Request processed in 199us (17517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927334.508929:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927334.508981:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075279744 00000100:00100000:1.0:1788927334.508993:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075279744 00000100:00100000:1.0:1788927334.509051:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788927334.509060:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075279744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927334.509099:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075279744:12345-0@lo:400:kworker.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927334.509106:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788927334.509165:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dd38a80 x1875826075279744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927334.509184:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075279744:0@lo:400:kworker.0 00000100:00100000:1.0:1788927334.509243:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075279232:0@lo:400:kworker.0 00000100:00100000:0.0:1788927334.509965:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788927334.509982:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927334.510050:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075279616:12345-0@lo:400:kworker.0 Request processed in 75us (10327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927334.510058:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788927334.510298:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075279616:0@lo:400:kworker.0 00000100:00100000:2.0:1788927334.510808:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075279488:0@lo:400:kworker.0 00000100:00100000:3.0:1788927334.510992:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:0.0:1788927335.324835:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927335.630554:0:9855:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Wed Sep 9 00:15:33 EDT 2026 00010000:00010000:1.0:1788927336.346843:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927337.374779:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927338.008833:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927338.008872:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927338.008904:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227008 00000100:00100000:2.0:1788927338.008913:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227008 00000100:00100000:2.0:1788927338.008959:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 204 00000100:00100000:2.0:1788927338.008969:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053227008:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927338.009036:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053227008:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927338.009053:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 204 00000100:00100000:2.0:1788927338.009087:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227136 00000100:00100000:2.0:1788927338.009093:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227136 00000100:00100000:2.0:1788927338.009133:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 58 00000100:00100000:2.0:1788927338.009140:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053227136:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927338.009170:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053227136:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927338.009177:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 58 00000100:00080000:2.0:1788927338.009242:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788927338.396345:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927339.099052:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075280000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788927339.099130:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927339.099780:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280000 00000100:00100000:0.0:1788927339.099796:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280000 00000100:00100000:0.0:1788927339.099860:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788927339.099869:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075280000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927339.099909:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00080000:1.0:1788927339.103206:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788927339.103782:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075280000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3907us (4645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927339.103796:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788927339.105368:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449a9880 x1875826075280000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927339.105395:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075280000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927339.418802:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927339.611096:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927339.611119:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075280128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927339.611188:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927339.611621:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280128 00000100:00100000:2.0:1788927339.611631:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280128 00000100:00100000:2.0:1788927339.611697:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788927339.611713:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075280128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927339.611739:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927339.611796:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075280128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927339.611804:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788927339.612012:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449aaa00 x1875826075280128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927339.612031:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075280128:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788927339.612142:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788927339.615680:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927339.617739:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075280512:0@lo:400:kworker.0 00000100:00100000:3.0:1788927339.617740:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075280384:0@lo:400:kworker.0 00000100:00100000:1.0:1788927339.621651:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075280640:0@lo:400:kworker.0 00000100:00100000:0.0:1788927339.624930:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927339.625180:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280512 00000100:00100000:2.0:1788927339.625190:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280512 00000100:00100000:2.0:1788927339.625249:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788927339.625274:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075280512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927339.625339:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075280512:12345-0@lo:400:kworker.0 Request processed in 70us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927339.625346:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788927339.626638:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927339.626691:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075280512:0@lo:400:kworker.0 00000100:00100000:3.0:1788927339.627735:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927339.628020:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280384 00000100:00100000:2.0:1788927339.628029:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280384 00000100:00100000:2.0:1788927339.628091:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788927339.628101:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075280384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927339.628175:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075280384:12345-0@lo:400:kworker.0 Request processed in 76us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927339.628182:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788927339.628593:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075280384:0@lo:400:kworker.0 00000100:00100000:1.0:1788927339.629862:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927339.629934:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075280256:0@lo:400:kworker.0 00000100:00100000:1.0:1788927339.629979:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927339.630225:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280640 00000100:00100000:2.0:1788927339.630233:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280640 00000100:00100000:2.0:1788927339.630310:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788927339.630319:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075280640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927339.630384:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075280640:12345-0@lo:400:kworker.0 Request processed in 54us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927339.630391:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788927339.630577:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927339.630659:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280256 00000100:00100000:3.0:1788927339.630665:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280256 00000100:00100000:3.0:1788927339.630702:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788927339.630718:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3443:x1875826075280256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927339.630758:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3443:x1875826075280256:12345-0@lo:400:kworker.0 Request processed in 41us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927339.630764:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788927339.631237:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075280640:0@lo:400:kworker.0 00000100:00100000:1.0:1788927339.631249:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075280256:0@lo:400:kworker.0 00010000:00010000:0.0:1788927340.442802:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927341.466847:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927342.492483:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927343.125904:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927343.125952:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927343.126020:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227264 00000100:00100000:3.0:1788927343.126031:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227264 00000100:00100000:3.0:1788927343.126089:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 206 00000100:00100000:3.0:1788927343.126098:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053227264:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927343.126177:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053227264:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927343.126186:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 206 00000100:00100000:0.0:1788927343.126455:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227392 00000100:00100000:0.0:1788927343.126460:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227392 00000100:00100000:0.0:1788927343.126520:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 62 00000100:00100000:0.0:1788927343.126528:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053227392:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927343.126577:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053227392:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 51us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927343.126584:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 62 00000100:00080000:2.0:1788927343.126677:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788927343.516061:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927344.224577:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075280768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788927344.224674:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927344.225188:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280768 00000100:00100000:2.0:1788927344.225197:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280768 00000100:00100000:2.0:1788927344.226299:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788927344.226311:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075280768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927344.226341:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927344.226408:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075280768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927344.226414:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788927344.227786:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449aad80 x1875826075280768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927344.227812:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075280768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788927344.229619:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788927344.538723:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927344.733350:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075281152:0@lo:400:kworker.0 00000100:00100000:2.0:1788927344.733421:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927344.733495:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927344.733511:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075281280:0@lo:400:kworker.0 00000100:00100000:2.0:1788927344.733548:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927344.733790:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281152 00000100:00100000:0.0:1788927344.733798:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281152 00000100:00100000:0.0:1788927344.733857:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281280 00000100:00100000:0.0:1788927344.733860:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281280 00000100:00100000:0.0:1788927344.733883:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788927344.733891:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927344.733948:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075281152:12345-0@lo:400:kworker.0 Request processed in 57us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927344.733955:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788927344.733970:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788927344.733976:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075281280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927344.734007:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075281280:12345-0@lo:400:kworker.0 Request processed in 31us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927344.734013:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788927344.734065:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075281280:0@lo:400:kworker.0 00000100:00100000:0.0:1788927344.734075:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075281152:0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734183:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075281024:0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734212:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927344.734248:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788927344.734254:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075280896:0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734280:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927344.734303:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075281408:0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734337:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927344.734369:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281024 00000100:00100000:1.0:1788927344.734380:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281024 00000100:00100000:1.0:1788927344.734407:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788927344.734413:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075281024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734449:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075281024:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927344.734455:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788927344.734474:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075280896 00000100:00100000:1.0:1788927344.734477:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075280896 00000100:00100000:1.0:1788927344.734504:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788927344.734511:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075280896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734550:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075280896:12345-0@lo:400:kworker.0 Request processed in 39us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927344.734556:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788927344.734591:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281408 00000100:00100000:1.0:1788927344.734623:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281408 00000100:00100000:1.0:1788927344.734648:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788927344.734654:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075281408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734679:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075281408:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927344.734685:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788927344.734712:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075280896:0@lo:400:kworker.0 00010000:00080000:1.0:1788927344.734723:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674ddf80 x1875826075281408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927344.734733:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075281408:0@lo:400:kworker.0 00000100:00100000:1.0:1788927344.734741:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075281024:0@lo:400:kworker.0 00000100:00080000:2.0:1788927344.734957:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788927344.734962:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927344.740339:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075281536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927344.740406:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927344.742212:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281536 00000100:00100000:1.0:1788927344.742234:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281536 00000100:00100000:1.0:1788927344.742295:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788927344.742305:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075281536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788927344.742347:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927344.742419:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075281536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927344.742427:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788927344.744087:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dfb80 x1875826075281536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927344.744111:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075281536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788927345.567377:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927346.588400:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927347.611908:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927348.233383:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927348.233441:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927348.233567:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227648 00000100:00100000:1.0:1788927348.233577:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227648 00000100:00100000:1.0:1788927348.233659:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 66 00000100:00100000:1.0:1788927348.233670:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053227648:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927348.233740:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053227648:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 71us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927348.233748:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 66 00000100:00080000:2.0:1788927348.233859:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927348.233945:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227520 00000100:00100000:3.0:1788927348.233950:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227520 00000100:00100000:3.0:1788927348.233988:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 208 00000100:00100000:3.0:1788927348.234004:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053227520:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927348.234032:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053227520:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 37us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927348.234038:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 208 00010000:00010000:0.0:1788927348.635273:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927349.343804:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927349.343825:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075281664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927349.343889:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927349.343949:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281664 00000100:00100000:2.0:1788927349.343958:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281664 00000100:00100000:2.0:1788927349.344012:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788927349.344021:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075281664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927349.344050:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927349.344090:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075281664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927349.344097:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788927349.344118:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788927349.344147:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449a9880 x1875826075281664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927349.344180:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075281664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788927349.658795:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927349.852377:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075281792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927349.852445:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927349.852936:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075282048:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.852970:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927349.852992:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788927349.852997:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075281920:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853023:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927349.853056:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281920 00000100:00100000:2.0:1788927349.853062:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281920 00000100:00100000:2.0:1788927349.853100:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788927349.853108:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189482f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075281920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853156:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189482f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075281920:12345-0@lo:400:kworker.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927349.853164:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788927349.853218:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075281920:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853239:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075282304:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853262:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927349.853278:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788927349.853283:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189605c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075282176:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853302:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927349.853327:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282048 00000100:00100000:2.0:1788927349.853330:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282048 00000100:00100000:2.0:1788927349.853369:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282304 00000100:00100000:2.0:1788927349.853372:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282304 00000100:00100000:2.0:1788927349.853392:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282176 00000100:00100000:2.0:1788927349.853395:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282176 00000100:00100000:2.0:1788927349.853408:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788927349.853413:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075282048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853448:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075282048:12345-0@lo:400:kworker.0 Request processed in 34us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927349.853454:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788927349.853466:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788927349.853487:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075282304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853541:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075282304:12345-0@lo:400:kworker.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927349.853548:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788927349.853563:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788927349.853571:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075282176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853634:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075282176:12345-0@lo:400:kworker.0 Request processed in 65us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927349.853640:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788927349.853658:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927349.853678:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075282048:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853699:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075282176:0@lo:400:kworker.0 00000100:00100000:2.0:1788927349.853708:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189605c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075282304:0@lo:400:kworker.0 00000100:00100000:0.0:1788927349.854171:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075281792 00000100:00100000:0.0:1788927349.854176:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075281792 00000100:00100000:0.0:1788927349.854237:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788927349.854245:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075281792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788927349.854268:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927349.854312:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075281792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927349.854329:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788927349.854363:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674de680 x1875826075281792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927349.854380:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075281792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788927349.854838:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788927350.683863:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927351.707819:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927352.730889:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927353.349828:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927353.349899:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927353.350453:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227776 00000100:00100000:3.0:1788927353.350467:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227776 00000100:00100000:3.0:1788927353.350550:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 210 00000100:00100000:3.0:1788927353.350562:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053227776:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927353.350701:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943b44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053227776:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 141us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927353.350710:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 210 00000100:00100000:3.0:1788927353.352770:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053227904 00000100:00100000:3.0:1788927353.352783:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053227904 00000100:00100000:3.0:1788927353.352886:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 70 00000100:00100000:3.0:1788927353.352899:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053227904:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927353.353172:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053227904:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 265us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927353.353181:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 70 00000100:00080000:2.0:1788927353.354548:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788927353.754974:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927354.460172:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075282432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788927354.460285:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927354.460370:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282432 00000100:00100000:1.0:1788927354.460380:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282432 00000100:00100000:1.0:1788927354.460458:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788927354.460480:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075282432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788927354.460520:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927354.468110:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075282432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7612us (7805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927354.468128:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788927354.468185:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788927354.486355:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484ed80 x1875826075282432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927354.486392:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075282432:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788927354.664272:0:10582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683192 <= 34618625) for LU-18938, skip 360 00010000:00010000:2.0:1788927354.779761:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927354.970952:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927354.971075:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927354.971313:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282560 00000100:00100000:2.0:1788927354.971323:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282560 00000100:00100000:2.0:1788927354.971517:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788927354.971529:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075282560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927354.971568:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927354.971648:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075282560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927354.971656:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788927354.972137:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075282688:0@lo:400:kworker.0 00000100:00100000:1.0:1788927354.972195:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927354.972231:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788927354.972237:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075282816:0@lo:400:kworker.0 00000100:00100000:1.0:1788927354.972262:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927354.972371:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282688 00000100:00100000:3.0:1788927354.972377:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282688 00000100:00100000:3.0:1788927354.972416:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788927354.972424:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3443:x1875826075282688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.972473:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943b44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3443:x1875826075282688:12345-0@lo:400:kworker.0 Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927354.972480:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788927354.972512:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282816 00000100:00100000:3.0:1788927354.972515:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282816 00000100:00100000:3.0:1788927354.972541:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788927354.972547:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075282816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.972575:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075282816:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927354.972580:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788927354.972632:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075282944:0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.972659:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927354.972677:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788927354.972681:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075283072:0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.972703:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927354.972730:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075282944 00000100:00100000:3.0:1788927354.972733:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075282944 00000100:00100000:1.0:1788927354.972803:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075283200:0@lo:400:kworker.0 00000100:00100000:1.0:1788927354.972826:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927354.972859:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075282816:0@lo:400:kworker.0 00000100:00100000:1.0:1788927354.972868:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075282688:0@lo:400:kworker.0 00000100:00100000:1.0:1788927354.972897:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283200 00000100:00100000:1.0:1788927354.972899:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283200 00000100:00080000:0.0:1788927354.972992:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788927354.972998:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788927354.973255:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788927354.973264:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075282944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.973306:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075282944:12345-0@lo:400:kworker.0 Request processed in 44us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927354.973327:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788927354.973420:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788927354.973428:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075283200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927354.973475:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075283200:12345-0@lo:400:kworker.0 Request processed in 48us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927354.973481:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788927354.973545:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283072 00000100:00100000:3.0:1788927354.973551:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283072 00010000:00080000:2.0:1788927354.973709:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484ed80 x1875826075282560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927354.973731:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927354.973863:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788927354.973871:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075283072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.973909:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075283072:12345-0@lo:400:kworker.0 Request processed in 40us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927354.973916:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788927354.974002:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075283200:0@lo:400:kworker.0 00010000:00080000:3.0:1788927354.974280:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dc48e00 x1875826075283072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927354.974291:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075283072:0@lo:400:kworker.0 00000100:00100000:3.0:1788927354.974303:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075282944:0@lo:400:kworker.0 00010000:00010000:2.0:1788927355.803102:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927356.332438:0:10630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683192 < 34486116) for LU-14927, skip 0f 00010000:00010000:2.0:1788927356.830366:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927357.851248:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788927358.075364:0:10679:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683192 < 34681754) for LU-12550, skip 216 00000100:00100000:0.0:1788927358.469160:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927358.469234:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927358.469941:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228032 00000100:00100000:1.0:1788927358.469955:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228032 00000100:00100000:1.0:1788927358.470044:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 212 00000100:00100000:1.0:1788927358.470055:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053228032:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927358.470160:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053228032:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 107us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927358.470169:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 212 00000100:00100000:2.0:1788927358.470327:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228160 00000100:00100000:2.0:1788927358.470333:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228160 00000100:00100000:2.0:1788927358.470405:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 74 00000100:00100000:2.0:1788927358.470416:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053228160:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927358.470486:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053228160:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 73us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927358.470493:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 74 00000100:00080000:1.0:1788927358.471761:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788927358.878366:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927359.580946:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788927359.580970:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075283328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927359.581040:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927359.581286:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283328 00000100:00100000:2.0:1788927359.581295:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283328 00000100:00100000:2.0:1788927359.581354:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788927359.581365:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075283328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927359.581392:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927359.581457:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075283328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927359.581464:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788927359.581763:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788927359.581792:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884484ed80 x1875826075283328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927359.581824:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075283328:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788927359.809763:0:10727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 00010000:00010000:2.0:1788927359.899799:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927360.096668:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075283456:0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.096743:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927360.096807:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075283968:0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.096836:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927360.096864:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788927360.096871:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075283584:0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.096893:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927360.096911:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.096935:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927360.096978:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283968 00000100:00100000:3.0:1788927360.097224:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283968 00000100:00100000:3.0:1788927360.097276:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283584 00000100:00100000:3.0:1788927360.097279:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283584 00000100:00100000:3.0:1788927360.097300:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788927360.097309:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.097361:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075283968:12345-0@lo:400:kworker.0 Request processed in 53us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927360.097369:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788927360.097386:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788927360.097392:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.097418:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075283584:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927360.097423:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788927360.097456:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284096 00000100:00100000:3.0:1788927360.097459:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284096 00000100:00100000:3.0:1788927360.097483:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788927360.097490:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075284096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.097519:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075284096:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927360.097524:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788927360.097539:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788927360.097543:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927360.097573:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075283584:0@lo:400:kworker.0 00010000:00080000:3.0:1788927360.097587:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b37b80 x1875826075284096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927360.097620:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788927360.097641:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075283968:0@lo:400:kworker.0 00000100:00100000:2.0:1788927360.098221:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283456 00000100:00100000:2.0:1788927360.098227:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283456 00000100:00100000:2.0:1788927360.098268:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788927360.098277:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075283456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927360.098322:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946096850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075283456:12345-0@lo:400:kworker.0 Request processed in 47us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927360.098329:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788927360.098450:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075283840:0@lo:400:kworker.0 00000100:00100000:0.0:1788927360.098481:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927360.098514:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788927360.098521:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075283712:0@lo:400:kworker.0 00000100:00100000:0.0:1788927360.098542:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927360.098559:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075284224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788927360.098578:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927360.098624:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283840 00000100:00100000:0.0:1788927360.098628:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283840 00000100:00100000:0.0:1788927360.098663:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788927360.098669:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075283840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927360.098703:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075283840:12345-0@lo:400:kworker.0 Request processed in 35us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927360.098709:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788927360.098726:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284224 00000100:00100000:0.0:1788927360.098729:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284224 00000100:00100000:0.0:1788927360.098751:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788927360.098758:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075284224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927360.099061:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075283712 00000100:00100000:1.0:1788927360.099065:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075283712 00000100:00100000:1.0:1788927360.099102:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788927360.099109:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075283712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927360.099211:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075283712:12345-0@lo:400:kworker.0 Request processed in 102us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927360.099217:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788927360.099238:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927360.099265:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075283712:0@lo:400:kworker.0 00010000:00080000:1.0:1788927360.099275:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b35180 x1875826075283840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927360.099284:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075283840:0@lo:400:kworker.0 00002000:00000024:1.0:1788927360.099537:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927360.099577:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075284224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 821us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927360.099583:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788927360.099680:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884484ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075283456:0@lo:400:kworker.0 00010000:00080000:0.0:1788927360.100247:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dd500 x1875826075284224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927360.100262:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075284224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788927360.923337:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788927361.558364:0:10775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51c 51e 834 00010000:00010000:2.0:1788927361.951466:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927362.979250:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788927363.310225:0:10823:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 00:16:01 (1788927361) === 00000100:00100000:0.0:1788927363.593211:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927363.593367:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228288 00000100:00100000:3.0:1788927363.593380:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228288 00000100:00100000:3.0:1788927363.593458:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 214 00000100:00100000:3.0:1788927363.593470:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918946096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053228288:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927363.593581:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918946096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053228288:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927363.593589:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 214 00000100:00100000:0.0:1788927363.594552:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927363.594669:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228416 00000100:00100000:3.0:1788927363.594676:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228416 00000100:00100000:3.0:1788927363.594748:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 78 00000100:00100000:3.0:1788927363.594759:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053228416:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927363.594830:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053228416:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927363.594837:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 78 00000100:00080000:1.0:1788927363.594892:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788927363.995366:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927364.700789:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927364.700813:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075284352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927364.700882:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927364.700944:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284352 00000100:00100000:2.0:1788927364.700960:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284352 00000100:00100000:2.0:1788927364.701017:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788927364.701027:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075284352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927364.701057:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927364.701103:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075284352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927364.701110:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788927364.701131:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788927364.701160:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b35f80 x1875826075284352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927364.701192:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075284352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927365.020030:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927365.211190:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788927365.211260:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927365.211268:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075284608:0@lo:400:kworker.0 00000100:00100000:1.0:1788927365.211310:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927365.211322:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927365.211323:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075284480:0@lo:400:kworker.0 00000100:00100000:2.0:1788927365.211333:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075284864:0@lo:400:kworker.0 00000100:00100000:1.0:1788927365.211336:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075285120:0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.211360:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927365.211401:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927365.211405:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075284992:0@lo:400:kworker.0 00000100:00100000:1.0:1788927365.211414:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284736 00000100:00100000:1.0:1788927365.211421:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284736 00000100:00100000:0.0:1788927365.211452:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284864 00000100:00100000:0.0:1788927365.211457:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284864 00000100:00100000:1.0:1788927365.211471:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284608 00000100:00100000:1.0:1788927365.211479:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284608 00000100:00100000:0.0:1788927365.211485:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788927365.211493:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075284864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927365.211499:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788927365.211504:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075284736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.211750:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927365.211779:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284480 00000100:00100000:3.0:1788927365.211783:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284480 00000100:00100000:3.0:1788927365.211809:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788927365.211816:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075284480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.211861:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075284480:12345-0@lo:400:kworker.0 Request processed in 45us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927365.211869:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788927365.211899:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075284992 00000100:00100000:3.0:1788927365.211902:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075284992 00000100:00100000:3.0:1788927365.211920:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788927365.211926:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075284608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.211953:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075284608:12345-0@lo:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927365.211958:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788927365.211970:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788927365.211975:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075284992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.211997:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075284992:12345-0@lo:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927365.212003:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788927365.212040:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075284480:0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.212052:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075284992:0@lo:400:kworker.0 00000100:00100000:0.0:1788927365.213149:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075284864:12345-0@lo:400:kworker.0 Request processed in 1652us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927365.213160:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788927365.213368:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075284736:12345-0@lo:400:kworker.0 Request processed in 1862us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927365.213376:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788927365.213413:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927365.213435:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927365.213707:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927365.213748:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788927365.213786:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b35c00 x1875826075284864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927365.213797:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075284864:0@lo:400:kworker.0 00000100:00100000:2.0:1788927365.213808:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075284736:0@lo:400:kworker.0 00000100:00100000:1.0:1788927365.214372:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075284608:0@lo:400:kworker.0 00000100:00100000:1.0:1788927365.214408:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285248 00000100:00100000:1.0:1788927365.214414:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285248 00000100:00100000:1.0:1788927365.214459:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788927365.214469:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075285248:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788927365.214488:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788927365.214497:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927365.214551:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075285248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927365.214558:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788927365.214764:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674df100 x1875826075285248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927365.214792:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927365.216750:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285120 00000100:00100000:3.0:1788927365.216762:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285120 00000100:00100000:3.0:1788927365.216853:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788927365.216863:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075285120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927365.216940:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075285120:12345-0@lo:400:kworker.0 Request processed in 78us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927365.216947:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788927365.220140:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b34700 x1875826075285120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927365.220159:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075285120:0@lo:400:kworker.0 00010000:00010000:2.0:1788927366.043991:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927367.066795:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927368.094947:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927368.713129:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927368.713702:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228544 00000100:00100000:3.0:1788927368.713726:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228544 00000100:00100000:3.0:1788927368.714771:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 216 00000100:00100000:3.0:1788927368.714791:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053228544:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927368.714892:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053228544:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 108us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927368.714901:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 216 00000100:00100000:1.0:1788927368.715207:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927368.715344:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228672 00000100:00100000:1.0:1788927368.715353:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228672 00000100:00100000:1.0:1788927368.715426:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 82 00000100:00100000:1.0:1788927368.715435:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053228672:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927368.715481:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053228672:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 47us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927368.715488:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 82 00000100:00080000:1.0:1788927368.715524:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788927369.114761:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788927369.577697:0:11016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788927369.827131:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075285376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788927369.827227:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927369.827324:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285376 00000100:00100000:0.0:1788927369.827334:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285376 00000100:00100000:0.0:1788927369.827418:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788927369.827430:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075285376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927369.828913:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927369.829023:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075285376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1591us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927369.829035:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788927369.829094:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788927369.829139:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dc000 x1875826075285376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927369.829164:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075285376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788927370.138993:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927370.330927:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075285504:0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331007:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927370.331072:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075286016:0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331100:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927370.331130:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788927370.331136:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075285632:0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331159:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927370.331177:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075286144:0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331199:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927370.331231:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286016 00000100:00100000:3.0:1788927370.331238:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286016 00000100:00100000:3.0:1788927370.331286:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285632 00000100:00100000:3.0:1788927370.331289:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285632 00000100:00100000:3.0:1788927370.331309:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788927370.331318:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075286016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331378:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075286016:12345-0@lo:400:kworker.0 Request processed in 60us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927370.331385:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788927370.331401:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788927370.331407:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331447:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075285632:12345-0@lo:400:kworker.0 Request processed in 40us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927370.331454:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788927370.331475:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286144 00000100:00100000:3.0:1788927370.331478:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286144 00000100:00100000:3.0:1788927370.331516:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788927370.331523:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075286144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331556:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075286144:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927370.331562:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788927370.331577:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788927370.331581:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927370.331642:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075285632:0@lo:400:kworker.0 00010000:00080000:3.0:1788927370.331655:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593ce00 x1875826075286144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927370.331666:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075286144:0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.331674:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075286016:0@lo:400:kworker.0 00000100:00100000:1.0:1788927370.331877:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285504 00000100:00100000:1.0:1788927370.331881:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285504 00000100:00100000:1.0:1788927370.331910:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788927370.331917:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927370.331966:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075285504:12345-0@lo:400:kworker.0 Request processed in 50us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927370.331972:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788927370.332037:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075285504:0@lo:400:kworker.0 00000100:00100000:0.0:1788927370.332305:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788927370.332335:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927370.332371:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788927370.332396:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927370.332425:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927370.332431:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075285888:0@lo:400:kworker.0 00000100:00100000:0.0:1788927370.332453:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927370.333974:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285888 00000100:00100000:3.0:1788927370.333983:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285888 00000100:00100000:3.0:1788927370.334034:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788927370.334115:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075285888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927370.334195:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075285888:12345-0@lo:400:kworker.0 Request processed in 153us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927370.334202:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788927370.334323:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593c700 x1875826075285888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927370.334336:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075285888:0@lo:400:kworker.0 00000100:00100000:2.0:1788927370.334478:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286272 00000100:00100000:2.0:1788927370.334482:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286272 00000100:00100000:2.0:1788927370.334510:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788927370.334517:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075286272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927370.334539:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927370.334575:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075286272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927370.334581:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788927370.334676:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075285760 00000100:00100000:1.0:1788927370.334681:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075285760 00000100:00100000:1.0:1788927370.334725:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788927370.334732:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927370.334767:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075285760:12345-0@lo:400:kworker.0 Request processed in 36us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927370.334773:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788927370.334946:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927370.335004:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075285760:0@lo:400:kworker.0 00010000:00080000:0.0:1788927370.335015:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dc000 x1875826075286272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927370.335030:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075286272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788927371.162837:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927372.186834:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927373.214210:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927373.832670:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927373.832748:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927373.832866:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228928 00000100:00100000:0.0:1788927373.832875:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228928 00000100:00100000:0.0:1788927373.832943:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 86 00000100:00100000:0.0:1788927373.832953:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053228928:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927373.833019:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053228928:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 67us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927373.833037:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 86 00000100:00080000:3.0:1788927373.833365:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927373.833792:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053228800 00000100:00100000:2.0:1788927373.833800:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053228800 00000100:00100000:2.0:1788927373.833853:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 218 00000100:00100000:2.0:1788927373.833861:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053228800:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927373.833911:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053228800:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 50us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927373.833928:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 218 00010000:00010000:2.0:1788927374.235417:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927374.938832:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788927374.938855:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075286400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927374.938930:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927374.939230:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286400 00000100:00100000:0.0:1788927374.939237:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286400 00000100:00100000:0.0:1788927374.939302:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788927374.939311:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075286400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927374.939349:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927374.939398:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075286400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927374.939406:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788927374.939471:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788927374.939852:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dc000 x1875826075286400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927374.939869:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075286400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788927375.259529:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927375.450818:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075286528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927375.450893:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927375.450945:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286528 00000100:00100000:0.0:1788927375.450953:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286528 00000100:00080000:2.0:1788927375.450985:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788927375.451009:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788927375.451032:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075286528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788927375.451060:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927375.451125:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075286528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927375.451244:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075286656:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451277:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927375.451302:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788927375.451310:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075287040:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451347:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927375.451372:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286656 00000100:00100000:1.0:1788927375.451382:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286656 00000100:00100000:1.0:1788927375.451409:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788927375.451415:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075286656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451467:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075286656:12345-0@lo:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927375.451473:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788927375.451504:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287040 00000100:00100000:1.0:1788927375.451507:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287040 00000100:00100000:1.0:1788927375.451537:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788927375.451544:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075287040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451576:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075287040:12345-0@lo:400:kworker.0 Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927375.451582:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788927375.451635:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075287040:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451644:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075286656:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451668:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075286784:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451690:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927375.451709:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788927375.451714:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075286912:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.451734:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927375.451758:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286784 00000100:00100000:1.0:1788927375.451761:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286784 00000100:00100000:1.0:1788927375.451781:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075286912 00000100:00100000:1.0:1788927375.451784:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075286912 00000100:00100000:1.0:1788927375.451803:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788927375.451809:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075286784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.453704:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075286784:12345-0@lo:400:kworker.0 Request processed in 1892us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927375.453714:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788927375.453748:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788927375.453758:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075286912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.453786:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075286912:12345-0@lo:400:kworker.0 Request processed in 31us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927375.453791:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788927375.453908:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075286912:0@lo:400:kworker.0 00000100:00100000:1.0:1788927375.453930:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075286784:0@lo:400:kworker.0 00010000:00080000:1.0:1788927375.454006:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674ded80 x1875826075286528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927375.454093:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075286528:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788927375.454131:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927375.459901:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000020:00000004:1.0:1788927376.125815:0:11278:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788927376.126102:0:11278:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788927376.283084:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788927377.307580:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927378.331793:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788927378.514346:0:11375:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788927378.514555:0:11375:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788927378.946497:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927378.946540:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927378.946629:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229184 00000100:00100000:0.0:1788927378.946638:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229184 00000100:00100000:0.0:1788927378.946718:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 90 00000100:00100000:0.0:1788927378.946728:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053229184:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927378.946809:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053229184:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927378.946817:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 90 00000100:00080000:2.0:1788927378.946975:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927378.947078:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229056 00000100:00100000:1.0:1788927378.947083:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229056 00000100:00100000:1.0:1788927378.947117:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 220 00000100:00100000:1.0:1788927378.947124:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053229056:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927378.947149:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053229056:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927378.947155:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 220 00010000:00010000:2.0:1788927379.354999:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927380.060319:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075287168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927380.060400:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927380.060520:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287168 00000100:00100000:0.0:1788927380.060528:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287168 00000100:00100000:0.0:1788927380.060617:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788927380.060628:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075287168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927380.060657:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927380.060707:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075287168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927380.060714:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788927380.060751:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674df480 x1875826075287168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927380.060768:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075287168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788927380.060828:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788927380.379096:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927380.581736:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075287296:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.581816:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927380.581862:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075287808:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.581888:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927380.581913:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927380.581919:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075287424:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.581940:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927380.581969:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075287552:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582007:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927380.582027:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788927380.582032:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075287680:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582053:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927380.582082:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287296 00000100:00100000:3.0:1788927380.582089:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287296 00000100:00100000:3.0:1788927380.582132:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788927380.582230:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3443:x1875826075287296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582281:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3443:x1875826075287296:12345-0@lo:400:kworker.0 Request processed in 141us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927380.582316:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788927380.582350:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287808 00000100:00100000:3.0:1788927380.582354:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287808 00000100:00100000:3.0:1788927380.582386:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788927380.582393:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075287808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582426:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075287808:12345-0@lo:400:kworker.0 Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927380.582432:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788927380.582449:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287424 00000100:00100000:3.0:1788927380.582453:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287424 00000100:00100000:3.0:1788927380.582474:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287552 00000100:00100000:3.0:1788927380.582477:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287552 00000100:00100000:3.0:1788927380.582489:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287680 00000100:00100000:3.0:1788927380.582491:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287680 00000100:00100000:3.0:1788927380.582504:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788927380.582510:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075287424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582541:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075287424:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927380.582546:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788927380.582557:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788927380.582564:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582593:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075287552:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927380.582617:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788927380.582628:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788927380.582635:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075287680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582672:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075287680:12345-0@lo:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927380.582678:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788927380.582739:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075287680:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582750:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075287552:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582788:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075287424:0@lo:400:kworker.0 00000100:00100000:3.0:1788927380.582797:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075287296:0@lo:400:kworker.0 00010000:00080000:3.0:1788927380.582808:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dc4a300 x1875826075287808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927380.582818:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075287808:0@lo:400:kworker.0 00000100:00080000:2.0:1788927380.585653:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788927380.585665:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788927380.593415:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927380.593441:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075287936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788927380.593522:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927380.593576:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075287936 00000100:00100000:0.0:1788927380.593585:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075287936 00000100:00100000:0.0:1788927380.593998:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788927380.594010:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075287936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788927380.594039:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927380.594085:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075287936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927380.594094:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788927380.594210:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674df480 x1875826075287936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927380.594227:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075287936:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1788927380.766575:0:11473:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788927380.767241:0:11473:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788927381.404037:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927382.427685:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788927382.893392:0:11570:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788927382.893583:0:11570:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788927383.452137:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927384.068713:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927384.072443:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927384.072489:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229440 00000100:00100000:3.0:1788927384.072499:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229440 00000100:00100000:3.0:1788927384.072567:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 94 00000100:00100000:3.0:1788927384.072577:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053229440:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927384.072676:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053229440:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 99us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927384.072684:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 94 00000100:00080000:2.0:1788927384.073682:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927384.076962:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229312 00000100:00100000:0.0:1788927384.076978:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229312 00000100:00100000:0.0:1788927384.077048:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 222 00000100:00100000:0.0:1788927384.077061:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053229312:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927384.077260:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053229312:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 200us (8554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927384.077278:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 222 00010000:00010000:3.0:1788927384.476057:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927385.183737:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075288064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788927385.183874:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927385.183942:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288064 00000100:00100000:0.0:1788927385.184021:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288064 00000100:00100000:0.0:1788927385.184080:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788927385.184089:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075288064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927385.184120:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927385.184165:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075288064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927385.184183:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788927385.184205:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788927385.184234:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674df480 x1875826075288064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927385.184251:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075288064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788927385.498997:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927385.691416:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075288320:0@lo:400:kworker.0 00000100:00100000:0.0:1788927385.691479:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927385.691534:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927385.691540:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075288448:0@lo:400:kworker.0 00000100:00100000:0.0:1788927385.691563:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927385.691811:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075288576:0@lo:400:kworker.0 00000100:00100000:2.0:1788927385.691841:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927385.691870:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788927385.691875:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075288192:0@lo:400:kworker.0 00000100:00100000:2.0:1788927385.691903:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927385.691922:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075288704:0@lo:400:kworker.0 00000100:00100000:2.0:1788927385.691946:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927385.693780:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288320 00000100:00100000:2.0:1788927385.693792:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288320 00000100:00100000:3.0:1788927385.693842:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288448 00000100:00100000:3.0:1788927385.693855:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288448 00000100:00100000:2.0:1788927385.693856:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288576 00000100:00100000:2.0:1788927385.693862:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288576 00000100:00100000:2.0:1788927385.693892:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788927385.693907:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075288320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927385.693987:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075288320:12345-0@lo:400:kworker.0 Request processed in 86us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927385.694043:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788927385.694073:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075288832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927385.694196:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788927385.694264:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927385.694382:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075288320:0@lo:400:kworker.0 00000100:00100000:1.0:1788927385.694429:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288832 00000100:00100000:1.0:1788927385.694433:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288832 00000100:00100000:1.0:1788927385.694467:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788927385.694474:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075288832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788927385.694495:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927385.694545:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075288832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927385.694551:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788927385.694572:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788927385.694646:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593f480 x1875826075288832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927385.694661:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075288832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788927385.698835:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788927385.698860:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075288576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927385.698964:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075288576:12345-0@lo:400:kworker.0 Request processed in 117us (7122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927385.698971:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788927385.698989:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788927385.698995:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927385.699385:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075288448:12345-0@lo:400:kworker.0 Request processed in 42us (7473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927385.699754:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788927385.699828:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075288576:0@lo:400:kworker.0 00000100:00100000:3.0:1788927385.699982:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288192 00000100:00100000:3.0:1788927385.699989:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288192 00000100:00100000:3.0:1788927385.700025:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788927385.700032:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075288192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927385.704353:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075288192:12345-0@lo:400:kworker.0 Request processed in 4311us (12438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927385.704469:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788927385.704544:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288704 00000100:00100000:2.0:1788927385.704552:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288704 00000100:00100000:0.0:1788927385.704570:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075288448:0@lo:400:kworker.0 00000100:00100000:2.0:1788927385.704721:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788927385.704731:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075288704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927385.704786:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788927385.704810:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075288704:12345-0@lo:400:kworker.0 Request processed in 80us (12862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927385.704818:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788927385.704839:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075288192:0@lo:400:kworker.0 00010000:00080000:3.0:1788927385.704860:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dfb80 x1875826075288704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927385.704871:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075288704:0@lo:400:kworker.0 00010000:00010000:3.0:1788927386.522705:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788927387.051499:0:11715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788927387.558356:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927388.589580:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927389.191770:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927389.191832:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927389.195409:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229568 00000100:00100000:1.0:1788927389.195427:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229568 00000100:00100000:1.0:1788927389.195515:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 224 00000100:00100000:1.0:1788927389.195529:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053229568:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927389.195650:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053229568:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 123us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927389.195658:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 224 00000100:00100000:3.0:1788927389.195964:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229696 00000100:00100000:3.0:1788927389.195970:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229696 00000100:00100000:3.0:1788927389.196031:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 98 00000100:00100000:3.0:1788927389.196039:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053229696:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927389.196081:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053229696:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 43us (4249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927389.196088:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 98 00000100:00080000:1.0:1788927389.200743:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788927389.594805:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927390.307899:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927390.307942:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075288960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788927390.308036:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927390.308293:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075288960 00000100:00100000:1.0:1788927390.308303:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075288960 00000100:00100000:1.0:1788927390.308403:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788927390.308416:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075288960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788927390.308455:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927390.308518:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075288960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927390.308526:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788927390.308580:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91894593f480 x1875826075288960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927390.308660:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075288960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788927390.309250:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788927390.622781:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927390.811295:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075289344:0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.811393:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927390.811475:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927390.811482:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075289472:0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.811509:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927390.811554:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289344 00000100:00100000:2.0:1788927390.811563:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289344 00000100:00100000:2.0:1788927390.811660:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289472 00000100:00100000:2.0:1788927390.811664:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289472 00000100:00100000:2.0:1788927390.811691:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788927390.811701:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075289344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.811762:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075289344:12345-0@lo:400:kworker.0 Request processed in 61us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927390.811786:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788927390.811806:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788927390.811813:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075289472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.811846:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3443:x1875826075289472:12345-0@lo:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927390.811852:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1788927390.811873:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927390.811916:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3443:1875826075289472:0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.811929:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075289344:0@lo:400:kworker.0 00000100:00100000:0.0:1788927390.812051:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075289088:0@lo:400:kworker.0 00000100:00100000:0.0:1788927390.812093:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927390.812130:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075289600:0@lo:400:kworker.0 00000100:00100000:0.0:1788927390.812161:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927390.812249:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075289216:0@lo:400:kworker.0 00000100:00100000:1.0:1788927390.812283:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927390.812343:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075289728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927390.812370:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927390.812403:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289728 00000100:00100000:1.0:1788927390.812408:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289728 00000100:00100000:1.0:1788927390.812446:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788927390.812453:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075289728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788927390.812479:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927390.812521:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075289728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927390.812528:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788927390.812564:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dfb80 x1875826075289728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927390.812582:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075289728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927390.812813:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289088 00000100:00100000:2.0:1788927390.812817:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289088 00000100:00100000:2.0:1788927390.812853:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788927390.812860:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075289088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.812893:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075289088:12345-0@lo:400:kworker.0 Request processed in 34us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927390.812899:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1788927390.812924:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788927390.812933:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289216 00000100:00100000:2.0:1788927390.812937:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289216 00000100:00100000:2.0:1788927390.812959:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788927390.812964:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075289216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.812999:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075289216:12345-0@lo:400:kworker.0 Request processed in 34us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927390.813005:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788927390.813034:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075289216:0@lo:400:kworker.0 00000100:00100000:1.0:1788927390.827055:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075289088:0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.827714:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289600 00000100:00100000:2.0:1788927390.827726:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289600 00000100:00100000:2.0:1788927390.827804:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788927390.827819:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075289600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927390.827930:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075289600:12345-0@lo:400:kworker.0 Request processed in 116us (15767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927390.827938:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788927390.828014:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b34e00 x1875826075289600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927390.828029:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075289600:0@lo:400:kworker.0 00000020:00000080:0.0:1788927390.989475:0:11863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea44db730 20000000:00000080:0.0:1788927390.989499:0:11863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff918977b40800 uarg=0000000000000000 20000000:01000000:0.0:1788927390.989555:0:11863:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788927390.989562:0:11863:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788927390.989574:0:11863:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788927390.994834:0:11864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788927390.995048:0:11863:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788927391.012304:0:11863:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788927391.012382:0:11863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012407:0:11863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e957c expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012416:0:11863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012423:0:11863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e9598 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012434:0:11863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012443:0:11863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012538:0:11863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 9 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.012559:0:11863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 9 pid: 5947 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927391.012578:0:11863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075289856:192.168.203.54@tcp:104: 00010000:00010000:0.0:1788927391.014025:0:11863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e9598 expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.014057:0:11863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e9598 expref: 18 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927391.014071:0:11863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844774a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075289984:0@lo:104: 00000100:00100000:0.0:1788927391.014315:0:11863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927391.014361:0:11863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.014370:0:11863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927391.014380:0:11863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075290112:0@lo:104: 00000100:00100000:0.0:1788927391.014401:0:11863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788927391.014431:0:11863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x750239bd504e957c expref: 18 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.014440:0:11863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x750239bd504e957c expref: 18 pid: 5948 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927391.014448:0:11863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075290240:0@lo:104: 00000100:00100000:0.0:1788927391.014464:0:11863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927391.014473:0:11863:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748180 going to sleep for 11 seconds 00000100:00100000:3.0:1788927391.014534:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075289984 00000100:00100000:3.0:1788927391.014543:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075289984 00000100:00100000:3.0:1788927391.014588:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290112 00000100:00100000:3.0:1788927391.014590:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290112 00000100:00100000:3.0:1788927391.014632:0:5937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290240 00000100:00100000:3.0:1788927391.014635:0:5937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290240 00000100:00100000:3.0:1788927391.014649:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788927391.014657:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+5:11863:x1875826075289984:12345-0@lo:104: 00010000:00010000:3.0:1788927391.014673:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.014737:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788927391.014744:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+5:11863:x1875826075289984:12345-0@lo:104: Request processed in 87us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927391.014751:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788927391.014770:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788927391.014775:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+4:11863:x1875826075290112:12345-0@lo:104: 00010000:00010000:3.0:1788927391.014793:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.014824:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788927391.014829:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+4:11863:x1875826075290112:12345-0@lo:104: Request processed in 54us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927391.014835:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788927391.014846:0:5937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788927391.014851:0:5937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:11863:x1875826075290240:12345-0@lo:104: 00010000:00010000:3.0:1788927391.014858:0:5937:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.014878:0:5937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788927391.014883:0:5937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844775500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3b70cda-d4d0-488a-a813-7f141061abda+3:11863:x1875826075290240:12345-0@lo:104: Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927391.014889:0:5937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788927391.014902:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788927391.014908:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.014916:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1a00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927391.014921:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.014930:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927391.014938:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927391.014950:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788927391.014981:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.014988:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927391.015010:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015018:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918842fc1a00/0x750239bd504e9598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e959f expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015030:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788927391.015033:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015038:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951779600 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927391.015042:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015049:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927391.015055:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927391.015060:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788927391.015068:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015073:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927391.015083:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015090:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff918951779600/0x750239bd504e958a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9591 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015099:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788927391.015102:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015114:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6e00 already unused, calling callback (ffffffffc136ac20) 10000000:00010000:3.0:1788927391.015117:0:5943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015124:0:5943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788927391.015287:0:5943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788927391.015293:0:5943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788927391.015308:0:5943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015314:0:5943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788927391.015329:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015337:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.154@tcp lock: ffff9188448c6e00/0x750239bd504e957c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x750239bd504e9583 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.015352:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927391.015358:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927391.015361:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927391.015554:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075290624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788927391.015632:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927391.015793:0:11863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844774a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075289984:0@lo:104: 00000100:00100000:0.0:1788927391.015802:0:11863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075290112:0@lo:104: 00000100:00100000:0.0:1788927391.015809:0:11863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075290240:0@lo:104: 00000100:00100000:3.0:1788927391.016046:0:8019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290624 00000100:00100000:3.0:1788927391.016052:0:8019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290624 00010000:00010000:3.0:1788927391.016078:0:8019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e957c expref: 19 pid: 5948 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927391.016303:0:8019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788927391.016312:0:8019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918950fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075290624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788927391.016329:0:8019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927391.016338:0:8019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e957c expref: 19 pid: 5948 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.016348:0:8019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e957c expref: 19 pid: 5948 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.016365:0:8019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9188448c7600/0x750239bd504e9583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e957c expref: 19 pid: 5948 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.016380:0:8019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927391.016427:0:8019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918950fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b70cda-d4d0-488a-a813-7f141061abda+18:3445:x1875826075290624:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927391.016435:0:8019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788927391.016550:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075290624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788927391.018810:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075290368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788927391.018923:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927391.019003:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788927391.019010:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075290496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788927391.019034:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788927391.019068:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927391.019104:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290368 00000100:00100000:1.0:1788927391.019247:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290496 00000100:00100000:1.0:1788927391.019256:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290496 00010000:00010000:1.0:1788927391.019297:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927391.019332:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788927391.019342:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+18:3443:x1875826075290496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788927391.019356:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788927391.019362:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.019374:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.019397:0:5941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820df200/0x750239bd504e9591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e958a expref: 18 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.019413:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788927391.019459:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b70cda-d4d0-488a-a813-7f141061abda+17:3443:x1875826075290496:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927391.019468:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788927391.019522:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075290496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788927391.019572:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290368 00010000:00010000:3.0:1788927391.019591:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9598 expref: 17 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927391.019654:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788927391.019661:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dc4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+17:3443:x1875826075290368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788927391.019670:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927391.019674:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x750239bd504e9598 expref: 17 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.019682:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x750239bd504e9598 expref: 17 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.019692:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc1c00/0x750239bd504e959f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x750239bd504e9598 expref: 17 pid: 5949 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.019702:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927391.019731:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dc4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b70cda-d4d0-488a-a813-7f141061abda+16:3443:x1875826075290368:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927391.019738:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788927391.019814:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3b70cda-d4d0-488a-a813-7f141061abda:3443:1875826075290368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788927391.028311:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927391.028412:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229824 00000100:00100000:1.0:1788927391.028425:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229824 00010000:00010000:1.0:1788927391.028479:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 10 pid: 5947 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927391.028536:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 28 00000100:00100000:1.0:1788927391.028548:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053229824:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788927391.028576:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788927391.028582:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 10 pid: 5947 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028648:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 10 pid: 5947 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028678:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028688:0:5941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028710:0:5941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028718:0:5941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028726:0:5941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028754:0:5941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028761:0:5941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0600 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:1.0:1788927391.028767:0:5941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028776:0:5941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028787:0:5941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927391.028800:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788927391.028867:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053229824:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 320us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927391.028875:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 28 00010000:00010000:0.0:1788927391.029927:0:11863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9189820de000/0x750239bd504e95a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db909 expref: 9 pid: 5947 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927391.029970:0:11863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11863:1875826075289856:192.168.203.54@tcp:104: 00010000:00010000:0.0:1788927391.030008:0:11863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.030019:0:11863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.030025:0:11863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927391.030032:0:11863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff918842fc0600/0x750239bd504e95ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927391.642822:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788927392.218881:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788927392.218892:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9188410d4800 from 7 10000000:01000000:0.0:1788927392.218898:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788927392.218965:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.218980:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.219007:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927392.219040:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075290752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.219287:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.219368:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748180 going to sleep for 11 seconds 00000100:00100000:2.0:1788927392.219450:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290752 00000100:00100000:2.0:1788927392.219459:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290752 00000100:00100000:2.0:1788927392.219523:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788927392.219535:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+16:5951:x1875826075290752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927392.219552:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927392.219569:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9188448c6000/0x750239bd504e95bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e95b4 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.219742:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9188448c6000/0x750239bd504e95bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e95b4 expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.219758:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9188448c6000/0x750239bd504e95bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e95b4 expref: 17 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.219770:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c6000, rc 0) 00000100:00100000:2.0:1788927392.219817:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075290752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 284us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927392.219825:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788927392.220320:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075290752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927392.220356:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95bb expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.220366:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e95bb expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927392.220448:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075290880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.220485:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.220518:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748180 going to sleep for 11 seconds 00000100:00100000:1.0:1788927392.222239:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075290880 00000100:00100000:1.0:1788927392.222253:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075290880 00000100:00100000:1.0:1788927392.222323:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788927392.222335:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075290880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927392.222530:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075290880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927392.222539:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788927392.223244:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075290880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.223312:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.223383:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.223430:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748180 going to sleep for 11 seconds 00000100:00100000:1.0:1788927392.224491:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291008 00000100:00100000:1.0:1788927392.224504:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291008 00000100:00100000:1.0:1788927392.224563:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788927392.224575:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075291008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927392.226461:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075291008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1877us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927392.226477:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788927392.226578:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788927392.233587:0:11883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788927392.236915:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788927392.236964:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788927392.236979:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95bb expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.236994:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc0400/0x750239bd504e95b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95bb expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788927392.237006:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788927392.237013:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff918974bed000 from 7 10000000:01000000:0.0:1788927392.237017:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788927392.237066:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.237075:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.237098:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927392.237144:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.237243:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.237306:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748600 going to sleep for 11 seconds 00000100:00100000:2.0:1788927392.238810:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291136 00000100:00100000:2.0:1788927392.238826:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291136 00000100:00100000:2.0:1788927392.238918:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788927392.238931:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+17:5951:x1875826075291136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788927392.238954:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927392.238975:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9188448c7e00/0x750239bd504e95c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e95c2 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.239011:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9188448c7e00/0x750239bd504e95c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e95c2 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.239025:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9188448c7e00/0x750239bd504e95c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e95c2 expref: 18 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.239037:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c7e00, rc 0) 00000100:00100000:2.0:1788927392.239193:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075291136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927392.239201:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788927392.240271:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927392.240302:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95c9 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.240315:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e95c9 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927392.240429:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.240489:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.240540:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748600 going to sleep for 11 seconds 00000100:00100000:1.0:1788927392.240628:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291264 00000100:00100000:1.0:1788927392.240644:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291264 00000100:00100000:1.0:1788927392.240689:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788927392.240700:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075291264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927392.240840:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075291264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927392.240848:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788927392.241236:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.241271:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.241329:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.241362:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748600 going to sleep for 11 seconds 00000100:00100000:1.0:1788927392.243758:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291392 00000100:00100000:1.0:1788927392.243779:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291392 00000100:00100000:1.0:1788927392.243850:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788927392.243862:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075291392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927392.244069:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075291392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927392.244078:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788927392.244255:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788927392.246574:0:11884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788927392.256451:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788927392.256505:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788927392.256522:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95c9 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.256540:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff918842fc1600/0x750239bd504e95c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95c9 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788927392.256555:0:5951:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788927392.256558:0:5951:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91895033f000 from 7 10000000:01000000:2.0:1788927392.256561:0:5951:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788927392.256650:0:5951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.256678:0:5951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927392.256692:0:5951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927392.256726:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788927392.256820:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927392.256876:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918843b25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788927392.257004:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291520 00000100:00100000:0.0:1788927392.257014:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291520 00000100:00100000:0.0:1788927392.257079:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788927392.257091:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+18:5951:x1875826075291520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927392.257116:0:5947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927392.257131:0:5947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc0600/0x750239bd504e95d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x750239bd504e95d0 expref: -99 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.257160:0:5947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc0600/0x750239bd504e95d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x750239bd504e95d0 expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.257172:0:5947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc0600/0x750239bd504e95d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x750239bd504e95d0 expref: 19 pid: 5947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.257182:0:5947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0600, rc 0) 00000100:00100000:0.0:1788927392.257245:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075291520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927392.257253:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788927392.257306:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927392.257338:0:5951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95d7 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.257350:0:5951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x750239bd504e95d7 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927392.257421:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.257450:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.257466:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748780 going to sleep for 11 seconds 00000100:00100000:0.0:1788927392.257480:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291648 00000100:00100000:0.0:1788927392.257484:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291648 00000100:00100000:0.0:1788927392.257507:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788927392.257513:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075291648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.257663:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075291648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927392.257670:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788927392.257700:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.257728:0:5951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.257774:0:5951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927392.257788:0:5951:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844748780 going to sleep for 11 seconds 00000100:00100000:0.0:1788927392.257799:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291776 00000100:00100000:0.0:1788927392.257803:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291776 00000100:00100000:0.0:1788927392.257824:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788927392.257830:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075291776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788927392.257913:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:5951:x1875826075291776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927392.257921:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788927392.257963:0:5951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3b70cda-d4d0-488a-a813-7f141061abda:5951:1875826075291776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788927392.258677:0:11885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788927392.258728:0:5951:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788927392.258746:0:5951:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788927392.258754:0:5951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95d7 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.258763:0:5951:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.154@tcp lock: ffff9188448c6400/0x750239bd504e95d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x750239bd504e95d7 expref: -99 pid: 5951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927392.667004:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927392.776505:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927392.776560:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053229952 00000100:00100000:0.0:1788927392.776579:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053229952 00000100:00100000:0.0:1788927392.776668:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 235 00000100:00100000:0.0:1788927392.776681:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+9:5452:x1875826053229952:12345-192.168.203.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788927392.776702:0:5948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927392.776725:0:5948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff918842fc1c00/0x750239bd504e95de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db910 expref: -99 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.776761:0:5948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff918842fc1c00/0x750239bd504e95de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db910 expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.776774:0:5948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff918842fc1c00/0x750239bd504e95de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db910 expref: 10 pid: 5948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927392.776787:0:5948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1c00, rc 0) 00000100:00100000:0.0:1788927392.776859:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053229952:12345-192.168.203.54@tcp:101:ll_cfg_requeue.0 Request processed in 180us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927392.776867:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 235 00000100:00100000:0.0:1788927392.793968:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927392.794127:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230080 00000100:00100000:1.0:1788927392.794140:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230080 00000100:00100000:1.0:1788927392.794218:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 236 00000100:00100000:1.0:1788927392.794230:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053230080:12345-192.168.203.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788927392.794429:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053230080:12345-192.168.203.54@tcp:501:ll_cfg_requeue.0 Request processed in 200us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927392.794454:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 236 00000100:00100000:3.0:1788927392.796389:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927392.796464:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230208 00000100:00100000:1.0:1788927392.796475:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230208 00000100:00100000:1.0:1788927392.796534:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 237 00000100:00100000:1.0:1788927392.796546:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053230208:12345-192.168.203.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788927392.796731:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:5452:x1875826053230208:12345-192.168.203.54@tcp:503:ll_cfg_requeue.0 Request processed in 185us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927392.796740:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 237 00010000:00010000:3.0:1788927393.692737:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927394.314794:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927394.314854:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927394.314913:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230464 00000100:00100000:3.0:1788927394.314926:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230464 00000100:00100000:1.0:1788927394.314972:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230336 00000100:00100000:1.0:1788927394.314998:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230336 00000100:00100000:3.0:1788927394.315037:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 102 00000100:00100000:3.0:1788927394.315054:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053230464:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927394.315078:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 238 00000100:00100000:1.0:1788927394.315093:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053230336:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927394.315164:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053230464:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 112us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927394.315174:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 102 00000100:00100000:1.0:1788927394.315191:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2363:x1875826053230336:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 99us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927394.315215:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 238 00000100:00080000:3.0:1788927394.315219:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788927394.715487:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927395.425316:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788927395.425337:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075291904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927395.425401:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927395.427096:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075291904 00000100:00100000:0.0:1788927395.427108:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075291904 00000100:00100000:0.0:1788927395.427194:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788927395.427205:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075291904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927395.427236:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927395.427306:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075291904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927395.427314:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788927395.427337:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788927395.427468:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918844775f80 x1875826075291904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927395.427625:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075291904:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788927395.479456:0:12061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg354-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788927395.738727:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927395.934632:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075292032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927395.934700:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927395.935162:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075292288:0@lo:400:kworker.0 00000100:00100000:1.0:1788927395.935204:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927395.935222:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788927395.935234:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075292416:0@lo:400:kworker.0 00000100:00100000:1.0:1788927395.935254:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927395.935335:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075292160:0@lo:400:kworker.0 00000100:00100000:3.0:1788927395.935364:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927395.935393:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918941327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075292672:0@lo:400:kworker.0 00000100:00100000:3.0:1788927395.935412:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927395.935438:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927395.935443:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91897dc49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075292544:0@lo:400:kworker.0 00000100:00100000:3.0:1788927395.935463:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927395.935488:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292288 00000100:00100000:3.0:1788927395.935493:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292288 00000100:00100000:3.0:1788927395.935527:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292416 00000100:00100000:3.0:1788927395.935530:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292416 00000100:00100000:3.0:1788927395.935548:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292672 00000100:00100000:3.0:1788927395.935550:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292672 00000100:00100000:3.0:1788927395.935563:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788927395.935570:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075292288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927395.935640:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3445:x1875826075292288:12345-0@lo:400:kworker.0 Request processed in 69us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927395.935647:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788927395.935663:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788927395.935674:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075292416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927395.935698:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3445:x1875826075292416:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927395.935703:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788927395.935713:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788927395.935718:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075292672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927395.935741:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075292672:12345-0@lo:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927395.935747:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788927395.935778:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918941327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075292672:0@lo:400:kworker.0 00000100:00100000:1.0:1788927395.936018:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292160 00000100:00100000:1.0:1788927395.936023:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292160 00000100:00100000:1.0:1788927395.936056:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788927395.936063:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075292160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927395.936096:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075292160:12345-0@lo:400:kworker.0 Request processed in 34us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927395.936102:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788927395.936131:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3445:1875826075292416:0@lo:400:kworker.0 00000100:00100000:1.0:1788927395.936141:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3445:1875826075292288:0@lo:400:kworker.0 00000100:00100000:1.0:1788927395.936163:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075292160:0@lo:400:kworker.0 00000100:00100000:0.0:1788927395.936515:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292032 00000100:00100000:0.0:1788927395.936527:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292032 00000100:00100000:0.0:1788927395.936565:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788927395.936572:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075292032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788927395.936634:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927395.936672:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075292032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927395.936678:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788927395.936692:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788927395.936696:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788927395.936830:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9189674dc000 x1875826075292032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927395.936846:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075292032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927395.936874:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292544 00000100:00100000:2.0:1788927395.936877:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292544 00000100:00100000:2.0:1788927395.936911:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788927395.936918:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075292544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927395.936955:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075292544:12345-0@lo:400:kworker.0 Request processed in 38us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927395.936960:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788927395.936986:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91897dc49f80 x1875826075292544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927395.936997:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91897dc49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075292544:0@lo:400:kworker.0 00010000:00010000:2.0:1788927396.767705:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788927397.802614:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927398.818124:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927399.427322:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927399.427458:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927399.427636:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230720 00000100:00100000:2.0:1788927399.427650:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230720 00000100:00100000:2.0:1788927399.427743:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 106 00000100:00100000:2.0:1788927399.427757:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884491df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053230720:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927399.427858:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884491df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053230720:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 103us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927399.427867:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 106 00000100:00080000:3.0:1788927399.428133:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927399.429532:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230592 00000100:00100000:1.0:1788927399.429547:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230592 00000100:00100000:1.0:1788927399.429642:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 240 00000100:00100000:1.0:1788927399.429664:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053230592:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927399.429758:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053230592:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 104us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927399.429768:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 240 00010000:00010000:1.0:1788927399.841018:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927400.539023:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788927400.539057:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075292800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927400.539243:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927400.539398:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292800 00000100:00100000:1.0:1788927400.539409:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292800 00000100:00100000:1.0:1788927400.539490:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788927400.539502:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075292800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788927400.539540:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927400.539639:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075292800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927400.539756:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788927400.539844:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918844774a80 x1875826075292800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927400.539866:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844774a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075292800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788927400.540723:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788927400.860444:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927401.050813:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788927401.050837:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918941326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075292928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927401.050904:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927401.050962:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075292928 00000100:00100000:1.0:1788927401.050969:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075292928 00000100:00100000:1.0:1788927401.051018:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788927401.051026:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075292928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788927401.051054:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927401.051096:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075292928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927401.051102:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788927401.051121:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788927401.051158:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918941326300 x1875826075292928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927401.051176:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918941326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075292928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927401.051377:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075293440:0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.051406:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927401.051424:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788927401.051429:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075293312:0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.051467:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927401.051497:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293440 00000100:00100000:2.0:1788927401.051501:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293440 00000100:00100000:2.0:1788927401.051528:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788927401.051534:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075293440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.051567:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075293440:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927401.051573:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788927401.051588:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293312 00000100:00100000:2.0:1788927401.051622:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293312 00000100:00100000:2.0:1788927401.051652:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788927401.051658:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075293312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.051689:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3446:x1875826075293312:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927401.051694:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788927401.051724:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3446:1875826075293312:0@lo:400:kworker.0 00010000:00080000:2.0:1788927401.051734:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918977b36a00 x1875826075293440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788927401.051743:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075293440:0@lo:400:kworker.0 00000100:00100000:3.0:1788927401.051814:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075293184:0@lo:400:kworker.0 00000100:00100000:3.0:1788927401.051855:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927401.051875:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788927401.051881:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788927401.051906:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927401.051926:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075293568:0@lo:400:kworker.0 00000100:00100000:3.0:1788927401.051945:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927401.051968:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293056 00000100:00100000:3.0:1788927401.051977:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293056 00000100:00100000:3.0:1788927401.052002:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788927401.052009:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075293056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927401.052042:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3b70cda-d4d0-488a-a813-7f141061abda+19:3444:x1875826075293056:12345-0@lo:400:kworker.0 Request processed in 34us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927401.052047:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788927401.052082:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3b70cda-d4d0-488a-a813-7f141061abda:3444:1875826075293056:0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.052225:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293184 00000100:00100000:2.0:1788927401.052239:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293184 00000100:00100000:2.0:1788927401.052267:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293568 00000100:00100000:2.0:1788927401.052271:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293568 00000100:00100000:2.0:1788927401.052297:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788927401.052303:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075293184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.052339:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075293184:12345-0@lo:400:kworker.0 Request processed in 35us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927401.052345:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788927401.052357:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788927401.052363:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075293568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.052386:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3444:x1875826075293568:12345-0@lo:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927401.052392:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788927401.052416:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3444:1875826075293568:0@lo:400:kworker.0 00000100:00100000:2.0:1788927401.052436:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075293184:0@lo:400:kworker.0 00000100:00080000:1.0:1788927401.052637:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788927401.100015:0:12210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 00:16:38 (1788927398) === 00000100:00100000:0.0:1788927401.230499:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.243920:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230848 00000100:00100000:2.0:1788927401.243933:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230848 00000100:00100000:2.0:1788927401.244011:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:2.0:1788927401.244022:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:7497:x1875826053230848:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1788927401.244040:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927401.244062:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e95e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db917 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244125:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244139:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244168:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244183:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244191:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244198:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244268:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244294:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244301:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244307:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.244312:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244320:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244333:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:2.0:1788927401.244336:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927401.244340:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244347:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e95ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244360:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244366:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244373:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244379:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6e00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.244388:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244394:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244402:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff918942e73a00) 00010000:00010000:2.0:1788927401.244405:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927401.244408:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244413:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e95f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244444:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e95e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db917 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244454:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:2.0:1788927401.244457:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788927401.244461:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e95e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db917 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.244470:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c6600, rc 0) 00000100:00100000:2.0:1788927401.244529:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:7497:x1875826053230848:12345-192.168.203.54@tcp:101:bash.0 Request processed in 509us (14037us total) trans 0 rc 301/301 00000100:00100000:2.0:1788927401.244536:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00080000:2.0:1788927401.244577:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927401.249478:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.249632:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053230976 00000100:00100000:2.0:1788927401.249650:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053230976 00000100:00100000:2.0:1788927401.249724:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:2.0:1788927401.249756:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:7497:x1875826053230976:12345-192.168.203.54@tcp:101:bash.0 00010000:00010000:2.0:1788927401.249783:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927401.249813:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e95fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db91e expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249898:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249913:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249925:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249941:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249948:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249954:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.249996:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250012:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250018:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250033:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.250038:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250046:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250061:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:2.0:1788927401.250073:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927401.250078:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250085:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250115:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250123:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250129:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250136:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.250139:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250144:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250169:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff918942e73200) 00010000:00010000:2.0:1788927401.250171:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927401.250174:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250179:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250217:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e95fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db91e expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250227:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:2.0:1788927401.250228:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788927401.250234:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e95fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db91e expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.250242:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c7800, rc 0) 00000100:00100000:2.0:1788927401.250308:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:7497:x1875826053230976:12345-192.168.203.54@tcp:101:bash.0 Request processed in 555us (843us total) trans 0 rc 301/301 00000100:00100000:2.0:1788927401.250315:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:2.0:1788927401.257915:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927401.258262:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053231104 00000100:00100000:3.0:1788927401.258276:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053231104 00000100:00100000:3.0:1788927401.258436:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1 00000100:00100000:3.0:1788927401.258450:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:7497:x1875826053231104:12345-192.168.203.54@tcp:37:bash.0 00000100:00100000:0.0:1788927401.270414:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:7497:x1875826053231104:12345-192.168.203.54@tcp:37:bash.0 Request processed in 11952us (12496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.270435:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1 00000100:00100000:0.0:1788927401.291267:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.291326:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053231232 00000100:00100000:0.0:1788927401.291338:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053231232 00000100:00100000:0.0:1788927401.291400:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:0.0:1788927401.291410:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10391:x1875826053231232:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1788927401.291436:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927401.291463:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1a00/0x750239bd504e960f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db925 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.291542:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.291557:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.291586:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.291969:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.291993:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292005:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292062:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292068:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292074:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292079:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.292083:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292090:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292103:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:0.0:1788927401.292106:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.292110:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292131:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292155:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292161:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292165:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292169:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0200 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.292172:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292178:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292185:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff91894336ad00) 00010000:00010000:0.0:1788927401.292187:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.292190:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292195:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e961d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292243:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1a00/0x750239bd504e960f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db925 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292265:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:0.0:1788927401.292268:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.292272:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1a00/0x750239bd504e960f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db925 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.292284:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1a00, rc 0) 00000100:00100000:0.0:1788927401.292363:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10391:x1875826053231232:12345-192.168.203.54@tcp:101:rm.0 Request processed in 953us (1106us total) trans 0 rc 301/301 00000100:00100000:0.0:1788927401.292372:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:2.0:1788927401.408308:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.408365:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927401.408468:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053231360 00000100:00100000:3.0:1788927401.408479:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053231360 00000100:00100000:3.0:1788927401.408552:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:3.0:1788927401.408563:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053231360:12345-192.168.203.54@tcp:41:mkdir.0 00000004:00000024:3.0:1788927401.408648:0:5956:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446338560 avail 1300099072 00000100:00100000:3.0:1788927401.408732:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053231360:12345-192.168.203.54@tcp:41:mkdir.0 Request processed in 170us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927401.408740:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:0.0:1788927401.408883:0:5963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053231488 00000100:00100000:0.0:1788927401.408888:0:5963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053231488 00000100:00100000:0.0:1788927401.408924:0:5963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:0.0:1788927401.408932:0:5963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10394:x1875826053231488:12345-192.168.203.54@tcp:700:mkdir.0 00000100:00100000:0.0:1788927401.408973:0:5963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10394:x1875826053231488:12345-192.168.203.54@tcp:700:mkdir.0 Request processed in 43us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.408980:0:5963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:0.0:1788927401.413806:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.413957:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053231744 00000100:00100000:2.0:1788927401.413967:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053231744 00000100:00100000:2.0:1788927401.414025:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 14 00000100:00100000:2.0:1788927401.414037:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10394:x1875826053231744:12345-192.168.203.54@tcp:36:mkdir.0 00010000:00010000:2.0:1788927401.414142:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927401.414179:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e94f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db8f4 expref: 6 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414200:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918943025700) 00010000:00010000:2.0:1788927401.414211:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788927401.414271:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414283:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414292:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414326:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414334:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414340:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788927401.414972:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788927401.414983:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414991:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.414996:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.415008:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.415013:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.415020:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.415032:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918942e73200) 00010000:00010000:2.0:1788927401.415035:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927401.415039:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.415045:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e9624 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788927401.415061:0:5954:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003be0099a reply state 00000000d3ad24ca transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927401.415069:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788927401.415168:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10394:x1875826053231744:12345-192.168.203.54@tcp:36:mkdir.0 Request processed in 1132us (1372us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788927401.415176:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 14 00010000:00010000:1.0:1788927401.417428:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.417445:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.417452:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.417458:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927401.417476:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.417483:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.417499:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff918942e73a00) 00010000:00010000:1.0:1788927401.417502:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927401.417505:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.417512:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e962b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927401.436928:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927401.437005:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053231872 00000100:00100000:3.0:1788927401.437021:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053231872 00000100:00100000:3.0:1788927401.437093:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 15 00000100:00100000:3.0:1788927401.437106:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10395:x1875826053231872:12345-192.168.203.54@tcp:101:chmod.0 00010000:00010000:3.0:1788927401.437133:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927401.437173:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db92c expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.437269:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.437285:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.437298:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927401.437364:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788927401.437368:0:5956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788927401.437409:0:5956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.437437:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db92c expref: 8 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.437459:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db92c expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.437469:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918971b59800) 00010000:00010000:3.0:1788927401.437473:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788927401.437477:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de600, rc 0) 00000100:00100000:3.0:1788927401.437564:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10395:x1875826053231872:12345-192.168.203.54@tcp:101:chmod.0 Request processed in 460us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927401.437571:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 15 00000100:00100000:3.0:1788927401.441873:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.442017:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053232128 00000100:00100000:2.0:1788927401.442028:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053232128 00000100:00100000:2.0:1788927401.442100:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 16 00000100:00100000:2.0:1788927401.442112:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10395:x1875826053232128:12345-192.168.203.54@tcp:36:chmod.0 00010000:00010000:2.0:1788927401.442302:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927401.442340:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9639 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db92c expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.442387:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918971b59800) 00010000:00010000:2.0:1788927401.442401:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788927401.442443:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.442461:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.442472:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788927401.442951:0:5954:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e80e232 reply state 000000006c8ae5c5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927401.443023:0:5954:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788927401.443034:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788927401.443214:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:10395:x1875826053232128:12345-192.168.203.54@tcp:36:chmod.0 Request processed in 1103us (1353us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788927401.443223:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 16 00010000:00010000:1.0:1788927401.445926:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.445951:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.445959:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.445965:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6e00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927401.445969:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.445976:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.445992:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918942e73200) 00010000:00010000:1.0:1788927401.445994:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788927401.446011:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.446018:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9640 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927401.484746:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927401.485643:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053232256 00000100:00100000:1.0:1788927401.485658:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053232256 00000100:00100000:1.0:1788927401.485744:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 17 00000100:00100000:1.0:1788927401.485755:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10396:x1875826053232256:12345-192.168.203.54@tcp:101:chown.0 00010000:00010000:1.0:1788927401.485784:0:8589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927401.485808:0:8589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e9647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db933 expref: -99 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.485876:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e964e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.485889:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e964e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.485901:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e964e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788927401.485957:0:8589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788927401.485961:0:8589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788927401.486003:0:8589:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e964e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.486027:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e9647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db933 expref: 9 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.486046:0:8589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e964e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db933 expref: 8 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.486070:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91884393ad00) 00010000:00010000:1.0:1788927401.486073:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788927401.486076:0:8589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951779600, rc 0) 00000100:00100000:1.0:1788927401.486161:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:10396:x1875826053232256:12345-192.168.203.54@tcp:101:chown.0 Request processed in 408us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927401.486169:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 17 00000100:00100000:2.0:1788927401.490357:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.493255:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053232384 00000100:00100000:0.0:1788927401.493274:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053232384 00000100:00100000:0.0:1788927401.493415:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 18 00000100:00100000:0.0:1788927401.493443:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:10396:x1875826053232384:12345-192.168.203.54@tcp:101:chown.0 00010000:00010000:0.0:1788927401.493470:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927401.493495:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db93a expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493616:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493633:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493656:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493674:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493682:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493689:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493792:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e966a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493801:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e966a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493808:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e966a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788927401.493868:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788927401.493872:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788927401.493895:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e966a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493920:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493928:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493935:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493941:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1200 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.493946:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493954:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493969:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91884393ad00) 00010000:00010000:0.0:1788927401.493972:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.493977:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493984:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e965c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.493998:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494006:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494012:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494024:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1000 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.494027:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494033:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494042:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91894336ad00) 00010000:00010000:0.0:1788927401.494044:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.494047:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494053:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9663 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494090:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e9655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db93a expref: 10 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494126:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e966a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db93a expref: 9 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.494134:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a200) 00010000:00010000:0.0:1788927401.494136:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788927401.494139:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc0200, rc 0) 00000100:00100000:0.0:1788927401.494236:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+9:10396:x1875826053232384:12345-192.168.203.54@tcp:101:chown.0 Request processed in 798us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.494244:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 18 00000100:00100000:2.0:1788927401.497977:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927401.498075:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053232640 00000100:00100000:3.0:1788927401.498087:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053232640 00000100:00100000:3.0:1788927401.498184:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:3.0:1788927401.498197:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+9:10396:x1875826053232640:12345-192.168.203.54@tcp:36:chown.0 00010000:00010000:3.0:1788927401.498282:0:5956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927401.498315:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e966a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db93a expref: 9 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.498340:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a200) 00010000:00010000:3.0:1788927401.498353:0:5956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788927401.498390:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.498405:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.498415:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788927401.505016:0:5933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788927401.506348:0:5956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f8c6e50 reply state 000000005c294a05 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927401.506370:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788927401.506386:0:5956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788927401.506987:0:5956:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788927401.507014:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10396:x1875826053232640:12345-192.168.203.54@tcp:36:chown.0 Request processed in 8813us (9045us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788927401.507024:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 19 00010000:00010000:1.0:1788927401.507219:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.507230:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.507238:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.507245:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820df400 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927401.507251:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.507259:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.507279:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff918971b59500) 00010000:00010000:1.0:1788927401.507282:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788927401.507287:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.507294:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e9671 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927401.534383:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.535020:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053232768 00000100:00100000:0.0:1788927401.535046:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053232768 00000100:00100000:2.0:1788927401.535489:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:2.0:1788927401.535501:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10397:x1875826053232768:12345-192.168.203.54@tcp:101:touch.500 00010000:00010000:2.0:1788927401.535526:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927401.535674:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db941 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788927401.537660:0:5954:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1924us 00010000:00010000:0.0:1788927401.554981:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555002:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555014:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555029:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555036:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555044:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555130:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e968d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555139:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555155:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788927401.555183:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788927401.555187:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788927401.555222:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e968d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555234:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555250:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555257:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555263:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.555268:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555275:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555287:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91884393ad00) 00010000:00010000:0.0:1788927401.555291:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.555295:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555302:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0c00/0x750239bd504e967f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555313:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555320:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555326:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555331:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1000 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.555338:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555345:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555353:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91894336ad00) 00010000:00010000:0.0:1788927401.555355:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.555358:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555364:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1000/0x750239bd504e9686 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555399:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db941 expref: 8 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555413:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e968d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db941 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.555420:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:0.0:1788927401.555423:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788927401.555425:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918842fc1200, rc 0) 00000100:00100000:0.0:1788927401.555528:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10397:x1875826053232768:12345-192.168.203.54@tcp:101:touch.500 Request processed in 20029us (21157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.555537:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:3.0:1788927401.559231:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.560077:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053233024 00000100:00100000:0.0:1788927401.560090:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053233024 00000100:00100000:0.0:1788927401.560172:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 21 00000100:00100000:0.0:1788927401.560183:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:10397:x1875826053233024:12345-192.168.203.54@tcp:101:touch.500 00010000:00010000:0.0:1788927401.560215:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927401.560234:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1a00/0x750239bd504e9694 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db948 expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.560338:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.560356:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.560369:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.560419:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.560427:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.560434:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788927401.561281:0:5955:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788927401.561443:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481200/0x750239bd504e96a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.561455:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481200/0x750239bd504e96a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.561463:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481200/0x750239bd504e96a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.561508:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.561515:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.561521:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.561528:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc1400 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.561532:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.562024:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.562039:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:0.0:1788927401.562042:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.562046:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.562052:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1400/0x750239bd504e969b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788927401.562067:0:5955:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d529525 reply state 000000005d565be8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927401.562076:0:5955:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788927401.562114:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1a00/0x750239bd504e9694 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db948 expref: 10 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.562142:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481200/0x750239bd504e96a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db948 expref: 9 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.562160:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91894336aa00) 00010000:00010000:0.0:1788927401.562162:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788927401.562165:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967481200, rc 0) 00000100:00100000:0.0:1788927401.562281:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+10:10397:x1875826053233024:12345-192.168.203.54@tcp:101:touch.500 Request processed in 2099us (3058us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788927401.562291:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 21 00010000:00010000:0.0:1788927401.566375:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.566393:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.566401:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.566407:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918842fc0200 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.566413:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.566421:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.566438:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd767bf9b (ffff91894336af00) 00010000:00010000:0.0:1788927401.566441:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.566445:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.566464:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc0200/0x750239bd504e96a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927401.567716:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927401.568825:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053233280 00000100:00100000:1.0:1788927401.568839:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053233280 00000100:00100000:1.0:1788927401.569189:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 22 00000100:00100000:1.0:1788927401.569203:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+9:10397:x1875826053233280:12345-192.168.203.54@tcp:36:touch.500 00010000:00010000:1.0:1788927401.569412:0:8589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788927401.569439:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481200/0x750239bd504e96a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db948 expref: 9 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.569459:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91894336aa00) 00010000:00010000:1.0:1788927401.569469:0:8589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788927401.569525:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.569538:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.569547:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788927401.569730:0:8589:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001548a202 reply state 000000002f5a94a4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927401.569740:0:8589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788927401.569834:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+10:10397:x1875826053233280:12345-192.168.203.54@tcp:36:touch.500 Request processed in 634us (2139us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788927401.569841:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 22 00010000:00010000:0.0:1788927401.577865:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.577888:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.577897:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.577904:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951778e00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.577910:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.577919:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.577952:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91884393a800) 00010000:00010000:0.0:1788927401.577955:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.577960:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.577967:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918951778e00/0x750239bd504e96b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927401.578555:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.579303:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053233408 00000100:00100000:0.0:1788927401.579318:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053233408 00000100:00100000:0.0:1788927401.579385:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23 00000100:00100000:0.0:1788927401.579397:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+9:10397:x1875826053233408:12345-192.168.203.54@tcp:101:touch.500 00010000:00010000:0.0:1788927401.579457:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927401.579483:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480200/0x750239bd504e96be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db94f expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.579563:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480200/0x750239bd504e96be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db94f expref: 10 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.579578:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480200/0x750239bd504e96be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db94f expref: 10 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.579625:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91894336ad00) 00010000:00010000:0.0:1788927401.579629:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788927401.579633:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967480200, rc 0) 00000100:00100000:0.0:1788927401.579997:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+10:10397:x1875826053233408:12345-192.168.203.54@tcp:101:touch.500 Request processed in 601us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.580005:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23 00000100:00100000:2.0:1788927401.583995:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.584165:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053233536 00000100:00100000:0.0:1788927401.584178:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053233536 00000100:00100000:0.0:1788927401.584280:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:0.0:1788927401.584291:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1875826053233536:12345-192.168.203.54@tcp:8:touch.500 00010000:00080000:0.0:1788927401.584332:0:6942:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:0.0:1788927401.584370:0:6942:0:(genops.c:1385:class_connect()) connect: client 20893ea2-62f1-4ff2-a5ab-c8ef32fae354, cookie 0x750239bd504e96c5 00002000:00100000:0.0:1788927401.584384:0:6942:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20893ea2-62f1-4ff2-a5ab-c8ef32fae354/ffff91897dd05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788927401.584397:0:6942:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788927401.584502:0:6942:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788927401.584538:0:6942:0:(import.c:65:import_set_state_nolock()) ffff91897dd02800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788927401.584685:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2359:x1875826053233536:12345-192.168.203.54@tcp:8:touch.500 Request processed in 394us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.584695:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:1.0:1788927401.587114:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.587280:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053233664 00000100:00100000:2.0:1788927401.587293:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053233664 00000100:00100000:2.0:1788927401.587380:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:2.0:1788927401.587393:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:0:x1875826053233664:12345-192.168.203.54@tcp:2:touch.500 00000100:00080000:1.0:1788927401.587767:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788927401.604347:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1788927401.604364:0:8011:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000100:00100000:2.0:1788927401.604714:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:0:x1875826053233664:12345-192.168.203.54@tcp:2:touch.500 Request processed in 17310us (17608us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788927401.604731:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:1.0:1788927401.610915:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.611426:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053233920 00000100:00100000:2.0:1788927401.611437:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053233920 00000100:00100000:2.0:1788927401.611496:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 2 00000100:00100000:2.0:1788927401.611508:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+10:10397:x1875826053233920:12345-192.168.203.54@tcp:35:touch.500 00000100:00100000:2.0:1788927401.612753:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:10397:x1875826053233920:12345-192.168.203.54@tcp:35:touch.500 Request processed in 1234us (1834us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788927401.612765:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 2 00000100:00100000:0.0:1788927401.649960:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.650085:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053234048 00000100:00100000:2.0:1788927401.650099:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053234048 00000100:00100000:2.0:1788927401.650184:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24 00000100:00100000:2.0:1788927401.650196:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:10398:x1875826053234048:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1788927401.650220:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927401.650241:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e96cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db956 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.650330:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e96d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.650345:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.650356:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788927401.650398:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788927401.650402:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788927401.650439:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.650466:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e96cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db956 expref: 13 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.650483:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e96d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db956 expref: 12 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.650492:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:2.0:1788927401.650495:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788927401.650499:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c6600, rc 0) 00000100:00100000:2.0:1788927401.650567:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+12:10398:x1875826053234048:12345-192.168.203.54@tcp:101:rm.0 Request processed in 373us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927401.650574:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24 00000100:00100000:1.0:1788927401.654915:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.655204:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053234304 00000100:00100000:0.0:1788927401.655213:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053234304 00000100:00100000:0.0:1788927401.655277:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 25 00000100:00100000:0.0:1788927401.655287:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+12:10398:x1875826053234304:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1788927401.655307:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927401.655327:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481000/0x750239bd504e96da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db95d expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788927401.655421:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788927401.655553:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481000/0x750239bd504e96da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db95d expref: 14 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.655568:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91884393ad00) 00010000:00010000:0.0:1788927401.655571:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788927401.655576:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481000/0x750239bd504e96da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db95d expref: 14 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.655588:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967481000, rc 0) 00000100:00100000:0.0:1788927401.656135:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:10398:x1875826053234304:12345-192.168.203.54@tcp:101:rm.0 Request processed in 846us (1225us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788927401.656143:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 25 00000100:00100000:1.0:1788927401.664185:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.664280:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053234432 00000100:00100000:0.0:1788927401.664289:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053234432 00000100:00100000:0.0:1788927401.664337:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:0.0:1788927401.664359:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:10398:x1875826053234432:12345-192.168.203.54@tcp:37:rm.0 00000100:00100000:0.0:1788927401.673204:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:10398:x1875826053234432:12345-192.168.203.54@tcp:37:rm.0 Request processed in 8835us (9220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.673218:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:1.0:1788927401.682360:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.682811:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053234688 00000100:00100000:2.0:1788927401.682821:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053234688 00000100:00100000:2.0:1788927401.682903:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:2.0:1788927401.682913:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949a89850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:10398:x1875826053234688:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:2.0:1788927401.684287:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949a89850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:10398:x1875826053234688:12345-192.168.203.54@tcp:35:rm.0 Request processed in 1369us (1930us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788927401.684298:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:1.0:1788927401.688681:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927401.689111:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053234944 00000100:00100000:3.0:1788927401.689119:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053234944 00000100:00100000:3.0:1788927401.689194:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00100000:3.0:1788927401.689205:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:10398:x1875826053234944:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:3.0:1788927401.689232:0:8589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927401.689252:0:8589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e96e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db964 expref: -99 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.689355:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e96ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.689369:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e96ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.689380:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e96ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927401.689392:0:8589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788927401.689526:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e96e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db964 expref: 17 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.689543:0:8589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e96ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db964 expref: 16 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.689552:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:3.0:1788927401.689555:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788927401.689558:0:8589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df000, rc 0) 00000100:00100000:3.0:1788927401.691268:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053234944:12345-192.168.203.54@tcp:101:rm.0 Request processed in 2055us (2586us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788927401.691297:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00100000:1.0:1788927401.699950:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.700250:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053235072 00000100:00100000:2.0:1788927401.700260:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053235072 00000100:00100000:2.0:1788927401.700322:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 27 00000100:00100000:2.0:1788927401.700332:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053235072:12345-192.168.203.54@tcp:41:rm.0 00000004:00000024:2.0:1788927401.700387:0:5955:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847337984 avail 7384293376 00000100:00100000:2.0:1788927401.700457:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053235072:12345-192.168.203.54@tcp:41:rm.0 Request processed in 125us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927401.700465:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 27 00000100:00100000:2.0:1788927401.705807:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927401.706128:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053235200 00000100:00100000:0.0:1788927401.706138:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053235200 00000100:00100000:0.0:1788927401.706212:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 28 00000100:00100000:0.0:1788927401.706224:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053235200:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1788927401.706245:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927401.706265:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481000/0x750239bd504e96fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db96b expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706326:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706339:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706349:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706363:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706370:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706376:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706473:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706481:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706488:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788927401.706520:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788927401.706524:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788927401.706540:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706552:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706559:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706565:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706570:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706576:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967481c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.706580:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706588:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706642:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:0.0:1788927401.706644:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.706648:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706655:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706665:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706671:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706677:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706682:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480400 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.706685:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706690:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706696:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd767bf9b (ffff91894336af00) 00010000:00010000:0.0:1788927401.706698:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.706896:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.706904:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480400/0x750239bd504e970b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.715467:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481000/0x750239bd504e96fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db96b expref: 18 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.715499:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db96b expref: 17 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.715509:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91894336ad00) 00010000:00010000:0.0:1788927401.715512:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788927401.715515:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967480c00, rc 0) 00000100:00100000:0.0:1788927401.715612:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+17:10398:x1875826053235200:12345-192.168.203.54@tcp:101:rm.0 Request processed in 9375us (9799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927401.715621:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 28 00000100:00100000:1.0:1788927401.723555:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.728340:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053235456 00000100:00100000:2.0:1788927401.728355:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053235456 00000100:00100000:2.0:1788927401.728526:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 29 00000100:00100000:2.0:1788927401.728537:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+17:10398:x1875826053235456:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:2.0:1788927401.728609:0:5955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788927401.728635:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480c00/0x750239bd504e9712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db96b expref: 17 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728668:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480200/0x750239bd504e96be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db94f expref: 16 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728678:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91894336ad00) 00010000:00010000:2.0:1788927401.728711:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e96d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db956 expref: 15 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728720:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:2.0:1788927401.728723:0:5955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788927401.728744:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728755:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728764:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728779:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728786:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728793:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728889:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728897:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.728904:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788927401.729133:0:5955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788927401.729163:0:5955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350853566508ns, next at 351853563910ns, rc = 0 00010000:00010000:2.0:1788927401.729214:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729223:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729231:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729237:0:5955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729243:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729249:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729273:0:5955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788927401.729293:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729299:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729305:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729312:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.729316:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729334:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729344:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91884463a400) 00010000:00010000:2.0:1788927401.729346:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788927401.729350:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729355:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9727 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729369:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729375:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729381:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729386:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927401.729389:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729395:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729401:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:2.0:1788927401.729404:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927401.729407:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927401.729438:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e9719 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788927401.729449:0:5955:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e02cbc0b reply state 0000000093aea780 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927401.729457:0:5955:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788927401.729541:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053235456:12345-192.168.203.54@tcp:36:rm.0 Request processed in 1004us (5994us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788927401.729550:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 29 00010000:00010000:1.0:1788927401.730630:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788927401.730649:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.730658:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7600 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:1.0:1788927401.730662:0:5943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.730670:0:5943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.730684:0:5943:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91884463a400) 00010000:00010000:1.0:1788927401.730687:0:5943:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788927401.730690:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.730695:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e972e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927401.730714:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927401.730716:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927401.730730:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927401.739448:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.739465:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.739472:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.739479:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7800 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.739485:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.739492:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.739513:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd767bf9b (ffff91884463ac00) 00010000:00010000:0.0:1788927401.739529:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.739534:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.739540:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9720 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd767bf9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927401.747851:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927401.748001:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053235712 00000100:00100000:2.0:1788927401.748010:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053235712 00000100:00100000:2.0:1788927401.748073:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:2.0:1788927401.748083:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+15:10398:x1875826053235712:12345-192.168.203.54@tcp:35:rm.0 00000100:00100000:2.0:1788927401.748322:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053235712:12345-192.168.203.54@tcp:35:rm.0 Request processed in 239us (483us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788927401.748330:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:1.0:1788927401.753263:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927401.753396:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053235968 00000100:00100000:3.0:1788927401.753406:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053235968 00000100:00100000:3.0:1788927401.753520:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:3.0:1788927401.753532:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:10398:x1875826053235968:12345-192.168.203.54@tcp:36:rm.0 00010000:00010000:3.0:1788927401.753593:0:8589:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788927401.753671:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e96ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db964 expref: 16 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753692:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918842fc1200/0x750239bd504e968d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db941 expref: 15 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753703:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91894336a500) 00010000:00010000:3.0:1788927401.753720:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e964e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db933 expref: 14 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753729:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91884393ad00) 00010000:00010000:3.0:1788927401.753736:0:8589:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788927401.753757:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753769:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753779:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753789:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753811:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753818:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753910:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753918:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.753926:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927401.754165:0:8589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788927401.754178:0:8589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754185:0:8589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754191:0:8589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754198:0:8589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820dfc00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927401.754202:0:8589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754209:0:8589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754230:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff918971b59900) 00010000:00010000:3.0:1788927401.754233:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788927401.754237:0:8589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754243:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9743 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754262:0:8589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754267:0:8589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754273:0:8589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754277:0:8589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820dfe00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927401.754280:0:8589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754286:0:8589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754293:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918971b59300) 00010000:00010000:3.0:1788927401.754295:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927401.754298:0:8589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927401.754303:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e9735 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788927401.754325:0:8589:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004eb97e65 reply state 00000000cfb38393 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927401.754332:0:8589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788927401.754398:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+15:10398:x1875826053235968:12345-192.168.203.54@tcp:36:rm.0 Request processed in 868us (1144us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788927401.754406:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 30 00010000:00010000:0.0:1788927401.766233:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.766252:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.766260:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.766267:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820de200 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927401.766272:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.766279:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.766296:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff918971b59d00) 00010000:00010000:0.0:1788927401.766298:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927401.766302:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.766307:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e973c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927401.882878:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927402.907564:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927403.931637:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927404.548489:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927404.548533:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927404.548948:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236096 00000100:00100000:2.0:1788927404.548957:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236096 00000100:00100000:2.0:1788927404.549018:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 242 00000100:00100000:2.0:1788927404.549029:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2362:x1875826053236096:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927404.549094:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2362:x1875826053236096:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 68us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927404.549102:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 242 00000100:00100000:3.0:1788927404.549301:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927404.549500:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236224 00000100:00100000:2.0:1788927404.549505:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236224 00000100:00100000:2.0:1788927404.549569:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 110 00000100:00100000:2.0:1788927404.549576:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:2362:x1875826053236224:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927404.549632:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:2362:x1875826053236224:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927404.549639:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 110 00000100:00080000:1.0:1788927404.549705:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927404.551367:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236352 00000100:00100000:0.0:1788927404.551378:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236352 00000100:00100000:0.0:1788927404.551513:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:0.0:1788927404.551524:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2362:x1875826053236352:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927404.551636:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2362:x1875826053236352:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 113us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927404.551644:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00080000:1.0:1788927404.563340:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788927404.955031:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927405.660169:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075293696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927405.660251:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927405.660657:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293696 00000100:00100000:1.0:1788927405.660666:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293696 00000100:00100000:1.0:1788927405.660791:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788927405.660801:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075293696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788927405.660831:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927405.661047:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075293696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927405.661056:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788927405.661143:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918844777800 x1875826075293696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927405.661162:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075293696:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788927405.667686:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788927405.978890:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788927406.171324:0:8311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355295723398ns, next at 356295720105ns, rc = 0 00000100:00100000:0.0:1788927406.171448:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788927406.171469:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918941326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075293952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788927406.171538:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927406.173080:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927406.173097:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884496f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075294080:0@lo:400:kworker.0 00000100:00100000:3.0:1788927406.173163:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927406.173213:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884496d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075294208:0@lo:400:kworker.0 00000100:00100000:3.0:1788927406.173238:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927406.173291:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294080 00000100:00100000:3.0:1788927406.173298:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294080 00000100:00100000:3.0:1788927406.173347:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294208 00000100:00100000:3.0:1788927406.173350:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294208 00000100:00100000:3.0:1788927406.173379:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788927406.173387:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075294080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927406.173437:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3444:x1875826075294080:12345-0@lo:400:kworker.0 Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927406.173460:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788927406.173477:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788927406.173484:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075294208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927406.173513:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075294208:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927406.173519:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788927406.173534:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927406.173559:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884496d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075294208:0@lo:400:kworker.0 00000100:00100000:3.0:1788927406.173571:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884496f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3444:1875826075294080:0@lo:400:kworker.0 00000100:00100000:2.0:1788927406.173768:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884496ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075294336:0@lo:400:kworker.0 00000100:00100000:2.0:1788927406.173805:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927406.173821:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293952 00000100:00100000:1.0:1788927406.173828:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293952 00000100:00100000:2.0:1788927406.173847:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788927406.173855:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884496c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075293824:0@lo:400:kworker.0 00000100:00100000:1.0:1788927406.173885:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788927406.173889:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927406.173898:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075293952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927406.173917:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91884496f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075294464:0@lo:400:kworker.0 00002000:00000024:1.0:1788927406.173923:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927406.173944:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927406.173976:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075293952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927406.173982:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788927406.174734:0:3446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918941326d80 x1875826075293952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788927406.174755:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918941326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075293952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788927406.174784:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294464 00000100:00100000:0.0:1788927406.174789:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294464 00000100:00100000:0.0:1788927406.174840:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788927406.174849:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075294464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927406.174922:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075294464:12345-0@lo:400:kworker.0 Request processed in 74us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927406.174930:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788927406.174953:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294336 00000100:00100000:3.0:1788927406.174959:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294336 00000100:00100000:0.0:1788927406.174974:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075293824 00000100:00100000:0.0:1788927406.174980:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075293824 00000100:00100000:3.0:1788927406.175000:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788927406.175010:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075294336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927406.175015:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788927406.175026:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075293824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927406.175054:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075294336:12345-0@lo:400:kworker.0 Request processed in 45us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927406.175063:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788927406.175083:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075293824:12345-0@lo:400:kworker.0 Request processed in 58us (1196us total) trans 0 rc 0/0 00000100:00080000:3.0:1788927406.175087:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788927406.175093:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788927406.175104:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788927406.176112:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884496c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075293824:0@lo:400:kworker.0 00000100:00100000:1.0:1788927406.176142:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884496f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075294464:0@lo:400:kworker.0 00010000:00080000:1.0:1788927406.176155:0:3445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91884496ed80 x1875826075294336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927406.176176:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91884496ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075294336:0@lo:400:kworker.0 00000004:00080000:2.0:1788927406.692258:0:5933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788927406.692289:0:5933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788927406.692302:0:5933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788927406.692751:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927406.692781:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918941327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075294592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788927406.692863:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927406.693372:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294592 00000100:00100000:0.0:1788927406.693380:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294592 00000100:00100000:0.0:1788927406.693433:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788927406.693442:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075294592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788927406.693475:0:6942:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788927406.693508:0:6942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa0dda8, atime: 0x6aa0dda8, ctime: 0x6aa0dda8, blocks: 0x0 00010000:00010000:0.0:1788927406.693517:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927406.693533:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788927406.693538:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788927406.693545:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927406.693562:0:6942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927406.693586:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927406.693616:0:6942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927406.693640:0:6942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788927406.693998:0:5943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788927406.694006:0:5943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927406.694015:0:5943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480400 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:1.0:1788927406.694020:0:5943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927406.694030:0:5943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927406.694048:0:5943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927406.694056:0:5943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014044402/0x750239bd504e974a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927406.694076:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927406.694078:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927406.694080:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788927406.694443:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff918941327480/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788927406.694450:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918941327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075294592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788927406.694556:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3444:x1875826075294592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1113us (1691us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788927406.694564:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788927407.002984:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927408.028055:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927409.051003:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788927409.072519:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927409.072663:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236480 00000100:00100000:0.0:1788927409.072673:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236480 00000100:00100000:0.0:1788927409.072770:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 31 00000100:00100000:0.0:1788927409.072782:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:10911:x1875826053236480:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1788927409.072802:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927409.072825:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db972 expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.072891:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e9758 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.072914:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e9758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.072928:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e9758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788927409.072979:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788927409.072983:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788927409.073002:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e9758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.073027:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e9751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db972 expref: 7 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.073059:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e9758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db972 expref: 6 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.073082:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336a400) 00010000:00010000:0.0:1788927409.073086:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788927409.073089:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967480a00, rc 0) 00000100:00100000:0.0:1788927409.073169:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10911:x1875826053236480:12345-192.168.203.54@tcp:101:rm.0 Request processed in 388us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927409.073176:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 31 00000100:00080000:3.0:1788927409.074976:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927409.087323:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927409.087637:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236608 00000100:00100000:0.0:1788927409.087647:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236608 00000100:00100000:0.0:1788927409.087708:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 32 00000100:00100000:0.0:1788927409.087718:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10911:x1875826053236608:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:0.0:1788927409.087738:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927409.087757:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e975f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db979 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087815:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087829:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087839:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087890:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087898:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087932:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087972:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087979:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087985:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.087991:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967481600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927409.087995:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088002:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088015:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336a400) 00010000:00010000:0.0:1788927409.088019:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927409.088024:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088031:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e9766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088055:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088061:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088074:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088079:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480e00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927409.088082:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088089:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088106:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff91894336af00) 00010000:00010000:0.0:1788927409.088108:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927409.088111:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088117:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e976d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088148:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e975f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db979 expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088158:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336a400) 00010000:00010000:0.0:1788927409.088161:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788927409.088165:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481c00/0x750239bd504e975f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db979 expref: 7 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927409.088174:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967481c00, rc 0) 00000100:00100000:0.0:1788927409.088236:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:10911:x1875826053236608:12345-192.168.203.54@tcp:101:rm.0 Request processed in 519us (921us total) trans 0 rc 301/301 00000100:00100000:0.0:1788927409.088252:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 32 00000100:00100000:2.0:1788927409.675532:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927409.675842:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236736 00000100:00100000:1.0:1788927409.675851:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236736 00000100:00100000:1.0:1788927409.675954:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 244 00000100:00100000:1.0:1788927409.675964:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053236736:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927409.676056:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053236736:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 93us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927409.676063:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 244 00000100:00100000:3.0:1788927409.677073:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927409.677149:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236864 00000100:00100000:0.0:1788927409.677156:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236864 00000100:00100000:0.0:1788927409.677214:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00100000:0.0:1788927409.677232:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053236864:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927409.677286:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053236864:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 56us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927409.677301:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00080000:3.0:1788927409.677317:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788927410.074890:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927410.778880:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927410.778907:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075294720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788927410.778982:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927410.779132:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294720 00000100:00100000:1.0:1788927410.779140:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294720 00000100:00100000:1.0:1788927410.779220:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788927410.779231:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075294720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788927410.779262:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:1.0:1788927410.779311:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075294720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927410.779319:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788927410.779359:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918844775880 x1875826075294720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927410.779378:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075294720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788927410.779455:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788927411.100021:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927411.291556:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075294976:0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.291642:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927411.291708:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075295488:0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.291734:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927411.291765:0:3446:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788927411.291783:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075294848:0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.291809:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927411.291826:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075295360:0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.291846:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927411.291872:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295488 00000100:00100000:0.0:1788927411.291880:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295488 00000100:00100000:0.0:1788927411.291930:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788927411.291939:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1875826075295488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.291987:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3446:x1875826075295488:12345-0@lo:400:kworker.0 Request processed in 49us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927411.292010:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788927411.292032:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788927411.292063:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075295488:0@lo:400:kworker.0 00000100:00100000:3.0:1788927411.292200:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075295232:0@lo:400:kworker.0 00000100:00100000:3.0:1788927411.292230:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927411.292259:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788927411.292265:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075295104:0@lo:400:kworker.0 00000100:00100000:3.0:1788927411.292286:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927411.292355:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294976 00000100:00100000:2.0:1788927411.292360:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294976 00000100:00100000:2.0:1788927411.292393:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295360 00000100:00100000:2.0:1788927411.292396:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295360 00000100:00100000:2.0:1788927411.292414:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295104 00000100:00100000:2.0:1788927411.292424:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295104 00000100:00100000:2.0:1788927411.292443:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788927411.292450:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075294976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927411.292485:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3446:x1875826075294976:12345-0@lo:400:kworker.0 Request processed in 36us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927411.292491:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788927411.292505:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788927411.292511:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075295360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927411.292536:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3446:x1875826075295360:12345-0@lo:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927411.292542:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788927411.292553:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788927411.292559:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075295104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927411.292585:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3444:x1875826075295104:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927411.292590:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788927411.292629:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075294848 00000100:00100000:2.0:1788927411.292633:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075294848 00000100:00100000:2.0:1788927411.292656:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788927411.292662:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075294848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927411.292689:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075294848:12345-0@lo:400:kworker.0 Request processed in 28us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927411.292696:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788927411.292731:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927411.292813:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3444:1875826075295104:0@lo:400:kworker.0 00000100:00100000:1.0:1788927411.293036:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918941325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075295616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927411.293067:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927411.293202:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295232 00000100:00100000:0.0:1788927411.293206:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295232 00000100:00100000:0.0:1788927411.293237:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788927411.293245:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075295232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.293290:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075295232:12345-0@lo:400:kworker.0 Request processed in 46us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927411.293296:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788927411.293325:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075294848:0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.293336:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3446:1875826075295360:0@lo:400:kworker.0 00000100:00100000:0.0:1788927411.293346:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3446:1875826075294976:0@lo:400:kworker.0 00010000:00080000:3.0:1788927411.293426:0:3444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9188449a2d80 x1875826075295232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788927427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788927411.293437:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075295232:0@lo:400:kworker.0 00000100:00100000:2.0:1788927411.294501:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295616 00000100:00100000:2.0:1788927411.294509:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295616 00000100:00100000:2.0:1788927411.294556:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788927411.294577:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1875826075295616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927411.294640:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927411.294709:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3443:x1875826075295616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927411.294717:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788927411.294826:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918941325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075295616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788927412.122852:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788927412.830812:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1788927413.148320:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927414.178572:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788927414.730401:0:12287:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 157d: llapi changelog scanner API tests === 00:16:51 (1788927411) 00000100:00100000:1.0:1788927414.801209:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927414.801269:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927414.801301:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927414.801466:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053236992 00000100:00100000:0.0:1788927414.801481:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053236992 00000100:00100000:0.0:1788927414.801565:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 246 00000100:00100000:0.0:1788927414.801579:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053236992:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927414.801712:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918948274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2361:x1875826053236992:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 137us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927414.801720:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 246 00000100:00100000:0.0:1788927414.801776:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053237248 00000100:00100000:0.0:1788927414.801780:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053237248 00000100:00100000:0.0:1788927414.801826:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 39 00000100:00100000:0.0:1788927414.801842:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053237248:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927414.801873:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2361:x1875826053237248:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 34us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927414.801879:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 39 00000100:00080000:0.0:1788927414.801897:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788927414.802126:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053237120 00000100:00100000:2.0:1788927414.802131:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053237120 00000100:00100000:2.0:1788927414.802214:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 117 00000100:00100000:2.0:1788927414.802223:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053237120:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927414.802271:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053237120:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 50us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927414.802279:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 117 00000100:00080000:0.0:1788927414.804756:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788927415.135341:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927415.135482:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053237376 00000100:00100000:2.0:1788927415.135495:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053237376 00000100:00100000:2.0:1788927415.135580:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 33 00000100:00100000:2.0:1788927415.135593:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11286:x1875826053237376:12345-192.168.203.54@tcp:101:rm.0 00010000:00010000:2.0:1788927415.135680:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927415.135705:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db980 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135785:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135801:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135816:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135852:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135860:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135867:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135916:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135923:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135930:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135936:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927415.135942:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135950:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.135978:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336a400) 00010000:00010000:2.0:1788927415.135981:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927415.135985:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136000:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e977b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136019:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136026:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136032:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136036:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927415.136039:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136045:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136052:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff918942e73d00) 00010000:00010000:2.0:1788927415.136062:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927415.136065:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136070:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136104:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9774 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db980 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136114:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336a400) 00010000:00010000:2.0:1788927415.136117:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927415.136125:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db980 expref: 7 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.136135:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c7a00, rc 0) 00000100:00100000:2.0:1788927415.136210:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11286:x1875826053237376:12345-192.168.203.54@tcp:101:rm.0 Request processed in 620us (884us total) trans 0 rc 301/301 00000100:00100000:2.0:1788927415.136217:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 33 00000100:00100000:1.0:1788927415.165699:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927415.165841:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053237632 00000100:00100000:2.0:1788927415.165856:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053237632 00000100:00100000:2.0:1788927415.165932:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:2.0:1788927415.165944:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11287:x1875826053237632:12345-192.168.203.54@tcp:36:lfs.0 00010000:00010000:2.0:1788927415.166026:0:5955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927415.166073:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e9758 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db972 expref: 6 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166097:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336a400) 00010000:00010000:2.0:1788927415.166111:0:5955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788927415.166191:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166207:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166218:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166234:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166240:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166256:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788927415.166900:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788927415.166914:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166920:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166927:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166933:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927415.166938:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166945:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166955:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918942e73d00) 00010000:00010000:2.0:1788927415.166957:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927415.166961:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927415.166967:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9789 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788927415.166981:0:5955:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0883560 reply state 000000002ac6cfb8 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927415.167002:0:5955:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788927415.167146:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:11287:x1875826053237632:12345-192.168.203.54@tcp:36:lfs.0 Request processed in 1203us (1461us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788927415.167154:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 34 00010000:00010000:0.0:1788927415.171827:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927415.171851:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927415.171861:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927415.171867:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927415.171873:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927415.171882:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927415.171903:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff918942e73600) 00010000:00010000:0.0:1788927415.171906:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927415.171911:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927415.171917:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e9790 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927415.195498:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927415.899776:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788927415.899809:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075295744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927415.899901:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927415.900286:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295744 00000100:00100000:2.0:1788927415.900297:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295744 00000100:00100000:2.0:1788927415.900427:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788927415.900438:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918941327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075295744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788927415.900472:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927415.900518:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918941327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3443:x1875826075295744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927415.900523:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788927415.900967:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788927415.901042:0:3443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff918844775880 x1875826075295744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788927431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788927415.901084:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3443:1875826075295744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788927416.225622:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927416.411746:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075295872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788927416.412249:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075296128:0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.414897:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927416.414993:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788927416.415008:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075296256:0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.415067:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788927416.415128:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075296128 00000100:00100000:2.0:1788927416.415138:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075296128 00000100:00100000:2.0:1788927416.415194:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075296256 00000100:00100000:2.0:1788927416.415198:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075296256 00000100:00100000:2.0:1788927416.415231:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788927416.415240:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075296128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.415305:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075296128:12345-0@lo:400:kworker.0 Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927416.415312:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788927416.415340:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788927416.415347:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075296256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.415378:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075296256:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927416.415384:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788927416.415411:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927416.415449:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075296256:0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.415461:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075296128:0@lo:400:kworker.0 00000100:00100000:1.0:1788927416.422489:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927416.422771:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075296384:0@lo:400:kworker.0 00000100:00100000:1.0:1788927416.422912:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927416.422936:0:3445:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788927416.422943:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075296000:0@lo:400:kworker.0 00000100:00100000:1.0:1788927416.422973:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927416.422992:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9188449a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075296512:0@lo:400:kworker.0 00000100:00100000:1.0:1788927416.423019:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927416.423073:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075296512 00000100:00100000:1.0:1788927416.423082:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075296512 00000100:00100000:1.0:1788927416.423149:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788927416.423160:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897e0bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075296512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788927416.423218:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897e0bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075296512:12345-0@lo:400:kworker.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927416.423226:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788927416.423432:0:3445:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788927416.423438:0:3445:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff918941327480, transno 4294967300 00000100:00100000:1.0:1788927416.423461:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075296512:0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.423944:0:6944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075295872 00000100:00100000:2.0:1788927416.423950:0:6944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075295872 00000100:00100000:2.0:1788927416.423987:0:6944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788927416.423996:0:6944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075295872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788927416.424022:0:6944:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:2.0:1788927416.424084:0:6944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075295872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927416.424090:0:6944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788927416.424112:0:5949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075296000 00000100:00100000:2.0:1788927416.424115:0:5949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075296000 00000100:00100000:2.0:1788927416.424139:0:5949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788927416.424145:0:5949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075296000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.424173:0:5949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91896df48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3b70cda-d4d0-488a-a813-7f141061abda+19:3445:x1875826075296000:12345-0@lo:400:kworker.0 Request processed in 28us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927416.424179:0:5949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788927416.424207:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788927416.424223:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075296384 00000100:00100000:2.0:1788927416.424227:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075296384 00000100:00100000:2.0:1788927416.424270:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788927416.424276:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075296384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.424306:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075296384:12345-0@lo:400:kworker.0 Request processed in 31us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927416.424312:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788927416.424330:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788927416.424348:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3b70cda-d4d0-488a-a813-7f141061abda:3445:1875826075296000:0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.424360:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9188449a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075296384:0@lo:400:kworker.0 00000100:00100000:2.0:1788927416.424375:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9189674dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075295872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788927417.243760:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788927417.268682:0:12383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000020:00000080:0.0:1788927418.200053:0:12431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc0de387d0 00000004:00000080:0.0:1788927418.200077:0:12431:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9189493da400 uarg=0000000000000000 00000004:00000080:0.0:1788927418.200252:0:12431:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9189493da400 00000040:00080000:0.0:1788927418.200930:0:12431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788927418.203422:0:12431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788927418.203898:0:12431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:1.0:1788927418.203926:0:12431:0:(mdd_device.c:1855:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:1.0:1788927418.203930:0:12431:0:(mdd_device.c:471:mdd_changelog_on()) lustre-MDD0000: changelog on 00010000:00010000:0.0:1788927418.272499:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927418.367357:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927418.368297:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053237760 00000100:00100000:3.0:1788927418.368311:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053237760 00000100:00100000:3.0:1788927418.368407:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 35 00000100:00100000:3.0:1788927418.368420:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11329:x1875826053237760:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788927418.368453:0:8589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927418.368484:0:8589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db987 expref: -99 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788927418.368572:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788927418.368789:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e979e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.368807:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e979e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.368845:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e979e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927418.368906:0:8589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788927418.368911:0:8589:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788927418.368960:0:8589:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e979e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.368991:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db987 expref: 8 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.369013:0:8589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e979e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db987 expref: 7 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.369023:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918971b59d00) 00010000:00010000:3.0:1788927418.369026:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788927418.369040:0:8589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820dfe00, rc 0) 00000100:00100000:3.0:1788927418.370318:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:11329:x1875826053237760:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 1892us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927418.370330:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 35 00000100:00100000:1.0:1788927418.376710:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.376819:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238016 00000100:00100000:2.0:1788927418.376830:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238016 00000100:00100000:2.0:1788927418.376907:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00100000:2.0:1788927418.376918:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:11329:x1875826053238016:12345-192.168.203.54@tcp:36:llapi_scan_chan.0 00010000:00010000:2.0:1788927418.376992:0:5954:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927418.377028:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfe00/0x750239bd504e979e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db987 expref: 7 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927418.377061:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff918971b59d00) 00010000:00010000:2.0:1788927418.377076:0:5954:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788927418.377250:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11329:x1875826053238016:12345-192.168.203.54@tcp:36:llapi_scan_chan.0 Request processed in 333us (554us total) trans 0 rc -17/-17 00000100:00100000:2.0:1788927418.377259:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00100000:1.0:1788927418.387694:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.387805:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238144 00000100:00100000:0.0:1788927418.387818:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238144 00000100:00100000:0.0:1788927418.387884:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 37 00000100:00100000:0.0:1788927418.387897:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189674dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11329:x1875826053238144:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788927418.387925:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927418.387956:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e97a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db98e expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.388056:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480000/0x750239bd504e97ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.388073:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480000/0x750239bd504e97ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.388085:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480000/0x750239bd504e97ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788927418.388153:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788927418.388158:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788927418.388190:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff918967480000/0x750239bd504e97ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.388220:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e97a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db98e expref: 8 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.388257:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480000/0x750239bd504e97ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db98e expref: 7 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.388267:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336ad00) 00010000:00010000:0.0:1788927418.388270:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788927418.388274:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967480000, rc 0) 00000100:00100000:0.0:1788927418.388341:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189674dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:11329:x1875826053238144:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 447us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927418.388349:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 37 00000100:00100000:2.0:1788927418.400469:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927418.400578:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238272 00000100:00100000:3.0:1788927418.400591:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238272 00000100:00100000:3.0:1788927418.400689:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 38 00000100:00100000:3.0:1788927418.400704:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9189605c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:11329:x1875826053238272:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788927418.400742:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927418.400770:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e97b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db995 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.400888:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.400906:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.400920:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.400937:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.400944:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.400951:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401058:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e97c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401067:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e97c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401084:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e97c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927418.401140:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788927418.401148:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788927418.401174:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e97c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401199:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401207:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401215:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401223:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820df000 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927418.401228:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401237:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401253:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336ad00) 00010000:00010000:3.0:1788927418.401256:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927418.401262:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401269:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e97ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401284:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401291:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401298:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401312:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820dfa00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927418.401315:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401322:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401330:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf03956b8 (ffff918971b59500) 00010000:00010000:3.0:1788927418.401333:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927418.401336:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401343:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e97c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf03956b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401380:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e97b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db995 expref: 9 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401395:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de200/0x750239bd504e97c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db995 expref: 8 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.401403:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:3.0:1788927418.401405:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788927418.401408:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de200, rc 0) 00000100:00100000:3.0:1788927418.401625:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9189605c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:11329:x1875826053238272:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 924us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927418.401635:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 38 00000100:00100000:1.0:1788927418.407737:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.409760:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238528 00000100:00100000:0.0:1788927418.409778:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238528 00000100:00100000:0.0:1788927418.409861:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 39 00000100:00100000:0.0:1788927418.409875:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918945929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:11329:x1875826053238528:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788927418.409905:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927418.409933:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e97cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db99c expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.410089:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.410107:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.410121:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.410142:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.410158:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.410167:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788927418.417850:0:5955:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00000040:00080000:3.0:1788927418.418130:0:5955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788927418.418300:0:5955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00010000:00010000:3.0:1788927418.418826:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e97e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418848:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e97e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418863:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e97e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418912:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418920:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418929:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418936:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927418.418940:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418949:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418965:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:3.0:1788927418.418969:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927418.418974:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.418981:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e97d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788927418.419006:0:5955:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d2d556f reply state 000000005fd77103 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927418.419017:0:5955:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788927418.419074:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e97cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db99c expref: 11 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.419341:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e97e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db99c expref: 10 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.419352:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918971b59f00) 00010000:00010000:3.0:1788927418.419355:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788927418.419357:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820df400, rc 0) 00000100:00100000:3.0:1788927418.419464:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918945929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11329:x1875826053238528:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 9591us (11745us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788927418.419475:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 39 00010000:00010000:3.0:1788927418.433207:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.433230:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.433238:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.433245:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967481600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927418.433251:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.433271:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.433293:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb1bed465 (ffff91894336aa00) 00010000:00010000:3.0:1788927418.433296:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927418.433303:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927418.433309:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e97dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927418.433523:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.433711:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238656 00000100:00100000:1.0:1788927418.433724:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238656 00000100:00100000:1.0:1788927418.433776:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 15 00000100:00100000:1.0:1788927418.433787:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1875826053238656:12345-192.168.203.54@tcp:8:llapi_scan_chan.0 00010000:00080000:1.0:1788927418.433825:0:6943:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:1.0:1788927418.433942:0:6943:0:(genops.c:1385:class_connect()) connect: client 20893ea2-62f1-4ff2-a5ab-c8ef32fae354, cookie 0x750239bd504e97f2 00002000:00100000:1.0:1788927418.433957:0:6943:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20893ea2-62f1-4ff2-a5ab-c8ef32fae354/ffff918844b39000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113938 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788927418.433980:0:6943:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788927418.434092:0:6943:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788927418.434129:0:6943:0:(import.c:65:import_set_state_nolock()) ffff918844b3b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788927418.434222:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2359:x1875826053238656:12345-192.168.203.54@tcp:8:llapi_scan_chan.0 Request processed in 435us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.434231:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 15 00000100:00100000:0.0:1788927418.445427:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.446859:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238784 00000100:00100000:1.0:1788927418.446876:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238784 00000100:00100000:1.0:1788927418.446988:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 16 00000100:00100000:1.0:1788927418.447001:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11329:x1875826053238784:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788927418.447054:0:6941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927418.447099:0:6941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9a3 expref: -99 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788927418.447138:0:6941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788927418.447168:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788927418.447174:0:6941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788927418.447185:0:6941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 7 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.447209:0:6941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 7 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.447229:0:6941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951778e00, rc 0) 00000100:00100000:1.0:1788927418.447314:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:11329:x1875826053238784:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 316us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.447323:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 16 00000100:00080000:0.0:1788927418.447709:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788927418.467544:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.469691:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053238912 00000100:00100000:0.0:1788927418.469713:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053238912 00002000:00100000:0.0:1788927418.469784:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->0) req@ffff9188449a0380 x1875826053238912/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.469798:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a0380 with x1875826053238912 ext(0->0) 00002000:00010000:0.0:1788927418.469807:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a0380 00000100:00100000:0.0:1788927418.469848:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:0.0:1788927418.469860:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+7:2363:x1875826053238912:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000001:00100000:2.0:1788927418.472382:0:6935:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20893ea2-62f1-4ff2-a5ab-c8ef32fae354 00000100:00100000:0.0:1788927418.496999:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2363:x1875826053238912:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 27122us (29446us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788927418.497018:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 0 00002000:00100000:0.0:1788927418.497047:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->0) req@ffff9188449a0380 x1875826053238912/t4294967299(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.497060:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a0380 with x1875826053238912 ext(0->0) 00002000:00010000:0.0:1788927418.497068:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a0380 00000100:00100000:0.0:1788927418.505840:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.505898:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239040 00000100:00100000:0.0:1788927418.505911:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239040 00000100:00100000:0.0:1788927418.506001:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 40 00000100:00100000:0.0:1788927418.506017:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+10:11329:x1875826053239040:12345-192.168.203.54@tcp:44:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.512149:0:5933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:0.0:1788927418.512366:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:11329:x1875826053239040:12345-192.168.203.54@tcp:44:llapi_scan_chan.0 Request processed in 6346us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927418.512379:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 40 00000100:00100000:1.0:1788927418.526130:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.526364:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239168 00000100:00100000:2.0:1788927418.526378:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239168 00000100:00100000:2.0:1788927418.526639:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 17 00000100:00100000:2.0:1788927418.526653:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053239168:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788927418.532372:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788927418.532619:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053239168:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 5940us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.532633:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 17 00000100:00100000:1.0:1788927418.546706:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927418.546830:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239296 00000100:00100000:3.0:1788927418.546843:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239296 00002000:00100000:3.0:1788927418.546903:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->1) req@ffff91894592b480 x1875826053239296/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788927418.546916:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91894592b480 with x1875826053239296 ext(0->1) 00002000:00010000:3.0:1788927418.546923:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91894592b480 00000100:00100000:3.0:1788927418.546953:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 1 00000100:00100000:3.0:1788927418.546964:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894592b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053239296:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:3.0:1788927418.551231:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894592b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053239296:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 4257us (4529us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788927418.551246:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 1 00002000:00100000:3.0:1788927418.551257:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->1) req@ffff91894592b480 x1875826053239296/t4294967300(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788927418.551267:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91894592b480 with x1875826053239296 ext(0->1) 00002000:00010000:3.0:1788927418.551283:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91894592b480 00000100:00100000:0.0:1788927418.564884:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.564997:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239424 00000100:00100000:1.0:1788927418.565015:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239424 00000100:00100000:1.0:1788927418.565108:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 18 00000100:00100000:1.0:1788927418.565120:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053239424:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788927418.568000:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1788927418.568364:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053239424:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 3238us (3486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.568377:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 18 00000100:00100000:1.0:1788927418.580763:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.581079:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239552 00000100:00100000:0.0:1788927418.581094:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239552 00002000:00100000:0.0:1788927418.581170:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->2) req@ffff918967463800 x1875826053239552/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.581183:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967463800 with x1875826053239552 ext(0->2) 00002000:00010000:0.0:1788927418.581190:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967463800 00000100:00100000:0.0:1788927418.581225:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 2 00000100:00100000:0.0:1788927418.581238:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053239552:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.583372:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053239552:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 2121us (2610us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788927418.583389:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 2 00002000:00100000:0.0:1788927418.583401:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->2) req@ffff918967463800 x1875826053239552/t4294967301(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.583413:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967463800 with x1875826053239552 ext(0->2) 00002000:00010000:0.0:1788927418.583421:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967463800 00000100:00100000:2.0:1788927418.588246:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.588533:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239680 00000100:00100000:1.0:1788927418.588548:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239680 00000100:00100000:1.0:1788927418.589062:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:1.0:1788927418.589079:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053239680:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.590824:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788927418.591057:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053239680:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 1975us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.591070:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:2.0:1788927418.599124:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927418.603108:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239808 00000100:00100000:3.0:1788927418.603132:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239808 00002000:00100000:2.0:1788927418.603303:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->3) req@ffff9188449a2a00 x1875826053239808/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788927418.603313:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a2a00 with x1875826053239808 ext(0->3) 00002000:00010000:2.0:1788927418.603320:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a2a00 00000100:00100000:2.0:1788927418.603366:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 3 00000100:00100000:2.0:1788927418.603374:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053239808:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788927418.604560:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053239808:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1178us (5444us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788927418.604573:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 3 00002000:00100000:2.0:1788927418.604627:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->3) req@ffff9188449a2a00 x1875826053239808/t4294967302(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788927418.604636:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a2a00 with x1875826053239808 ext(0->3) 00002000:00010000:2.0:1788927418.604641:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a2a00 00000100:00100000:0.0:1788927418.613678:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.613893:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053239936 00000100:00100000:1.0:1788927418.613907:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053239936 00000100:00100000:1.0:1788927418.613983:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:1.0:1788927418.613997:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053239936:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788927418.617121:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788927418.621201:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053239936:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 7187us (7520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.621222:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:1.0:1788927418.630463:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.634918:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240064 00000100:00100000:0.0:1788927418.634939:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240064 00002000:00100000:0.0:1788927418.635042:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->4) req@ffff918967461f80 x1875826053240064/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.635056:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967461f80 with x1875826053240064 ext(0->4) 00002000:00010000:0.0:1788927418.635065:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967461f80 00000100:00100000:0.0:1788927418.635163:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 4 00000100:00100000:0.0:1788927418.635672:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053240064:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.638456:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053240064:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 3265us (8499us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788927418.638474:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 4 00002000:00100000:0.0:1788927418.638490:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->4) req@ffff918967461f80 x1875826053240064/t4294967303(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.638503:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967461f80 with x1875826053240064 ext(0->4) 00002000:00010000:0.0:1788927418.638510:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967461f80 00000100:00100000:2.0:1788927418.653778:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.654241:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240192 00000100:00100000:1.0:1788927418.654256:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240192 00000100:00100000:1.0:1788927418.654397:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 21 00000100:00100000:1.0:1788927418.654410:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053240192:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788927418.656496:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788927418.657330:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053240192:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 2912us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.657366:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 21 00000100:00100000:1.0:1788927418.665798:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.665870:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240320 00000100:00100000:2.0:1788927418.665881:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240320 00002000:00100000:2.0:1788927418.665953:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->5) req@ffff918967462d80 x1875826053240320/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788927418.665982:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967462d80 with x1875826053240320 ext(0->5) 00002000:00010000:2.0:1788927418.665989:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967462d80 00000100:00100000:2.0:1788927418.666026:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 5 00000100:00100000:2.0:1788927418.666048:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053240320:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:2.0:1788927418.669226:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053240320:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 3159us (3425us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788927418.669245:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 5 00002000:00100000:2.0:1788927418.669261:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->5) req@ffff918967462d80 x1875826053240320/t4294967304(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788927418.669274:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967462d80 with x1875826053240320 ext(0->5) 00002000:00010000:2.0:1788927418.669280:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967462d80 00000100:00100000:2.0:1788927418.674844:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.675526:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240448 00000100:00100000:1.0:1788927418.675540:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240448 00000100:00100000:1.0:1788927418.675673:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 22 00000100:00100000:1.0:1788927418.675686:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053240448:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788927418.679090:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:1.0:1788927418.679375:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053240448:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 3682us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.679389:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 22 00000100:00100000:0.0:1788927418.686362:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.686532:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240576 00000100:00100000:1.0:1788927418.686545:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240576 00002000:00100000:1.0:1788927418.686905:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->6) req@ffff918844776d80 x1875826053240576/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.686919:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918844776d80 with x1875826053240576 ext(0->6) 00002000:00010000:1.0:1788927418.686926:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918844776d80 00000100:00100000:1.0:1788927418.686967:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:1.0:1788927418.686980:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053240576:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.688331:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844776d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053240576:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1343us (1974us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788927418.688345:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00002000:00100000:1.0:1788927418.688356:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->6) req@ffff918844776d80 x1875826053240576/t4294967305(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.688366:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918844776d80 with x1875826053240576 ext(0->6) 00002000:00010000:1.0:1788927418.688391:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918844776d80 00000100:00100000:0.0:1788927418.694890:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.695090:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240704 00000100:00100000:1.0:1788927418.695103:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240704 00000100:00100000:1.0:1788927418.695170:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 23 00000100:00100000:1.0:1788927418.695183:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053240704:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788927418.696419:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788927418.697222:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053240704:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 1533us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.697239:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 23 00000100:00100000:2.0:1788927418.702321:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.702449:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240832 00000100:00100000:0.0:1788927418.702461:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240832 00002000:00100000:0.0:1788927418.702576:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->7) req@ffff9188449a1880 x1875826053240832/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.702592:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a1880 with x1875826053240832 ext(0->7) 00002000:00010000:0.0:1788927418.702685:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a1880 00000100:00100000:0.0:1788927418.702759:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:0.0:1788927418.702793:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053240832:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.704095:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053240832:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1296us (1778us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788927418.704109:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00002000:00100000:0.0:1788927418.704123:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->7) req@ffff9188449a1880 x1875826053240832/t4294967306(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 496/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.704133:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a1880 with x1875826053240832 ext(0->7) 00002000:00010000:0.0:1788927418.704138:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a1880 00000100:00100000:0.0:1788927418.707889:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.708080:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053240960 00000100:00100000:1.0:1788927418.708093:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053240960 00000100:00100000:1.0:1788927418.708161:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 24 00000100:00100000:1.0:1788927418.708174:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053240960:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:3.0:1788927418.709476:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1788927418.709778:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053240960:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 1602us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927418.709791:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 24 00000100:00100000:1.0:1788927418.714465:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.714574:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241088 00000100:00100000:0.0:1788927418.714586:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241088 00002000:00100000:0.0:1788927418.714784:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->8) req@ffff918967460000 x1875826053241088/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.714799:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967460000 with x1875826053241088 ext(0->8) 00002000:00010000:0.0:1788927418.714806:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967460000 00000100:00100000:0.0:1788927418.714940:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:0.0:1788927418.714952:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053241088:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.715936:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053241088:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 981us (1480us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788927418.715949:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00002000:00100000:0.0:1788927418.715959:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->8) req@ffff918967460000 x1875826053241088/t4294967307(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.715969:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967460000 with x1875826053241088 ext(0->8) 00002000:00010000:0.0:1788927418.715988:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967460000 00000100:00100000:3.0:1788927418.719740:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.719970:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241216 00000100:00100000:1.0:1788927418.719982:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241216 00000100:00100000:1.0:1788927418.720059:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 25 00000100:00100000:1.0:1788927418.720072:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053241216:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.721517:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:2.0:1788927418.721907:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053241216:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 1832us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.721920:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 25 00000100:00100000:1.0:1788927418.726505:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.726694:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241344 00000100:00100000:0.0:1788927418.726707:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241344 00002000:00100000:0.0:1788927418.726782:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->9) req@ffff918967460380 x1875826053241344/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.726794:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967460380 with x1875826053241344 ext(0->9) 00002000:00010000:0.0:1788927418.726801:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967460380 00000100:00100000:0.0:1788927418.726972:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:0.0:1788927418.726983:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053241344:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.727946:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053241344:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 957us (1447us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788927418.727957:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00002000:00100000:0.0:1788927418.727967:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->9) req@ffff918967460380 x1875826053241344/t4294967308(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.727978:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918967460380 with x1875826053241344 ext(0->9) 00002000:00010000:0.0:1788927418.727982:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918967460380 00000100:00100000:1.0:1788927418.730713:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.730854:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241472 00000100:00100000:2.0:1788927418.730864:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241472 00000100:00100000:2.0:1788927418.731055:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00100000:2.0:1788927418.731069:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053241472:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.733122:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788927418.733347:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053241472:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 2275us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.733356:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 26 00000100:00100000:3.0:1788927418.738868:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.738968:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241600 00000100:00100000:0.0:1788927418.738979:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241600 00002000:00100000:0.0:1788927418.739048:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->10) req@ffff91884496c700 x1875826053241600/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.739063:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91884496c700 with x1875826053241600 ext(0->10) 00002000:00010000:0.0:1788927418.739070:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91884496c700 00000100:00100000:0.0:1788927418.739164:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:0.0:1788927418.739175:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053241600:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.740120:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053241600:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 942us (1259us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788927418.740128:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00002000:00100000:0.0:1788927418.740136:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->10) req@ffff91884496c700 x1875826053241600/t4294967309(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.740143:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91884496c700 with x1875826053241600 ext(0->10) 00002000:00010000:0.0:1788927418.740146:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91884496c700 00000100:00100000:1.0:1788927418.742270:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.742353:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241728 00000100:00100000:2.0:1788927418.742364:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241728 00000100:00100000:2.0:1788927418.742456:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 27 00000100:00100000:2.0:1788927418.742465:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918967463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053241728:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.743705:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788927418.744068:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918967463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053241728:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 1598us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.744090:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 27 00000100:00100000:1.0:1788927418.747904:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.748663:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241856 00000100:00100000:0.0:1788927418.748679:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241856 00002000:00100000:1.0:1788927418.748847:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->11) req@ffff918977b24a80 x1875826053241856/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.748861:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b24a80 with x1875826053241856 ext(0->11) 00002000:00010000:1.0:1788927418.748867:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918977b24a80 00000100:00100000:1.0:1788927418.748906:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 11 00000100:00100000:1.0:1788927418.748918:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053241856:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.750196:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053241856:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1274us (2300us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788927418.750210:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 11 00002000:00100000:1.0:1788927418.750221:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->11) req@ffff918977b24a80 x1875826053241856/t4294967310(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.750231:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b24a80 with x1875826053241856 ext(0->11) 00002000:00010000:1.0:1788927418.750236:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918977b24a80 00000100:00100000:3.0:1788927418.753019:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.754116:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053241984 00000100:00100000:2.0:1788927418.754131:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053241984 00000100:00100000:2.0:1788927418.754215:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 28 00000100:00100000:2.0:1788927418.754228:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053241984:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.755385:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1788927418.755859:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053241984:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 1627us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.755874:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 28 00000100:00100000:0.0:1788927418.763112:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.763235:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242112 00000100:00100000:1.0:1788927418.763248:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242112 00002000:00100000:1.0:1788927418.763315:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff918943709c00 x1875826053242112/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.763327:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943709c00 with x1875826053242112 ext(0->12) 00002000:00010000:1.0:1788927418.763334:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943709c00 00000100:00100000:1.0:1788927418.763372:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 12 00000100:00100000:1.0:1788927418.763385:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053242112:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.768336:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053242112:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 4937us (5222us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788927418.768373:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 12 00002000:00100000:1.0:1788927418.768390:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff918943709c00 x1875826053242112/t4294967311(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.768401:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943709c00 with x1875826053242112 ext(0->12) 00002000:00010000:1.0:1788927418.768409:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943709c00 00000100:00100000:1.0:1788927418.773906:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.774458:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242240 00000100:00100000:2.0:1788927418.774472:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242240 00000100:00100000:2.0:1788927418.774645:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 29 00000100:00100000:2.0:1788927418.774659:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053242240:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.778422:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1788927418.779016:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053242240:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 4351us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.779040:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 29 00000100:00100000:2.0:1788927418.785177:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.785304:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242368 00000100:00100000:1.0:1788927418.785318:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242368 00002000:00100000:1.0:1788927418.785387:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->13) req@ffff9188449a3480 x1875826053242368/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.785400:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a3480 with x1875826053242368 ext(0->13) 00002000:00010000:1.0:1788927418.785406:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a3480 00000100:00100000:1.0:1788927418.785476:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 13 00000100:00100000:1.0:1788927418.785488:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053242368:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.786704:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053242368:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1209us (1535us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788927418.786718:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 13 00002000:00100000:1.0:1788927418.786738:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->13) req@ffff9188449a3480 x1875826053242368/t4294967312(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.786749:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9188449a3480 with x1875826053242368 ext(0->13) 00002000:00010000:1.0:1788927418.786754:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9188449a3480 00000100:00100000:0.0:1788927418.790955:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.791086:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242496 00000100:00100000:2.0:1788927418.791099:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242496 00000100:00100000:2.0:1788927418.791165:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:2.0:1788927418.791176:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053242496:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.794283:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1788927418.794565:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053242496:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 3382us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.794580:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:0.0:1788927418.801752:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.802102:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242624 00000100:00100000:1.0:1788927418.802114:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242624 00002000:00100000:1.0:1788927418.802200:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->14) req@ffff918943708700 x1875826053242624/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.802212:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943708700 with x1875826053242624 ext(0->14) 00002000:00010000:1.0:1788927418.802219:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943708700 00000100:00100000:1.0:1788927418.802259:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 14 00000100:00100000:1.0:1788927418.802270:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053242624:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.803818:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053242624:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1539us (2069us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788927418.803833:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 14 00002000:00100000:1.0:1788927418.803845:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->14) req@ffff918943708700 x1875826053242624/t4294967313(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.803855:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943708700 with x1875826053242624 ext(0->14) 00002000:00010000:1.0:1788927418.803862:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943708700 00000100:00100000:0.0:1788927418.809561:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.809770:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242752 00000100:00100000:2.0:1788927418.809783:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242752 00000100:00100000:2.0:1788927418.809852:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 31 00000100:00100000:2.0:1788927418.809865:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894370b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053242752:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.811499:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000100:00100000:2.0:1788927418.811878:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894370b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053242752:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 2010us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.811894:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 31 00000100:00100000:0.0:1788927418.818386:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.819002:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053242880 00000100:00100000:1.0:1788927418.819018:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053242880 00002000:00100000:1.0:1788927418.819111:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->15) req@ffff918943708000 x1875826053242880/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.819126:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943708000 with x1875826053242880 ext(0->15) 00002000:00010000:1.0:1788927418.819133:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943708000 00000100:00100000:1.0:1788927418.819180:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 15 00000100:00100000:1.0:1788927418.819193:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053242880:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.820519:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053242880:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1316us (2134us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788927418.820559:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 15 00002000:00100000:1.0:1788927418.820573:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->15) req@ffff918943708000 x1875826053242880/t4294967314(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 504/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.820585:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943708000 with x1875826053242880 ext(0->15) 00002000:00010000:1.0:1788927418.820590:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943708000 00000100:00100000:0.0:1788927418.828182:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.828311:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243008 00000100:00100000:2.0:1788927418.828325:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243008 00000100:00100000:2.0:1788927418.828436:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 32 00000100:00100000:2.0:1788927418.828449:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053243008:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.833246:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788927418.833477:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894370b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053243008:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 5022us (5304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.833491:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 32 00000100:00100000:0.0:1788927418.838982:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.839147:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243136 00000100:00100000:1.0:1788927418.839162:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243136 00002000:00100000:1.0:1788927418.839244:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->16) req@ffff918943708380 x1875826053243136/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.839257:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943708380 with x1875826053243136 ext(0->16) 00002000:00010000:1.0:1788927418.839264:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943708380 00000100:00100000:1.0:1788927418.839351:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 16 00000100:00100000:1.0:1788927418.839364:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053243136:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:1.0:1788927418.846198:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053243136:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 6819us (7213us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788927418.846215:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 16 00002000:00100000:1.0:1788927418.846230:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->16) req@ffff918943708380 x1875826053243136/t4294967315(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.846242:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918943708380 with x1875826053243136 ext(0->16) 00002000:00010000:1.0:1788927418.846249:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918943708380 00000100:00100000:0.0:1788927418.850859:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.851004:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243264 00000100:00100000:2.0:1788927418.851017:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243264 00000100:00100000:2.0:1788927418.851096:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 33 00000100:00100000:2.0:1788927418.851109:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053243264:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.852963:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788927418.853228:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053243264:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 2115us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.853241:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 33 00000100:00100000:0.0:1788927418.863887:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.864177:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243392 00000100:00100000:1.0:1788927418.864206:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243392 00002000:00100000:1.0:1788927418.864275:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->17) req@ffff91894370aa00 x1875826053243392/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788927418.864287:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91894370aa00 with x1875826053243392 ext(0->17) 00002000:00010000:1.0:1788927418.864295:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91894370aa00 00000100:00100000:1.0:1788927418.864336:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 17 00000100:00100000:1.0:1788927418.864347:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053243392:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.866715:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894370aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053243392:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 2355us (2828us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788927418.866740:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 17 00002000:00100000:0.0:1788927418.866756:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->17) req@ffff91894370aa00 x1875826053243392/t4294967316(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.866798:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91894370aa00 with x1875826053243392 ext(0->17) 00002000:00010000:0.0:1788927418.866805:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91894370aa00 00000100:00100000:0.0:1788927418.872337:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.872481:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243520 00000100:00100000:2.0:1788927418.872494:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243520 00000100:00100000:2.0:1788927418.872564:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:2.0:1788927418.872577:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053243520:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:1.0:1788927418.875403:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:2.0:1788927418.875694:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053243520:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 3100us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.875709:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 34 00000100:00100000:1.0:1788927418.892023:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.892158:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243648 00000100:00100000:0.0:1788927418.892174:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243648 00002000:00100000:0.0:1788927418.892260:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->18) req@ffff918977b24380 x1875826053243648/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.892274:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b24380 with x1875826053243648 ext(0->18) 00002000:00010000:0.0:1788927418.892282:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918977b24380 00000100:00100000:0.0:1788927418.892322:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 18 00000100:00100000:0.0:1788927418.892336:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053243648:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.894620:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053243648:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 2257us (2588us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788927418.894636:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 18 00002000:00100000:0.0:1788927418.894651:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->18) req@ffff918977b24380 x1875826053243648/t4294967317(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.894664:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b24380 with x1875826053243648 ext(0->18) 00002000:00010000:0.0:1788927418.894672:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918977b24380 00000100:00100000:0.0:1788927418.908560:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.908963:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243776 00000100:00100000:2.0:1788927418.908977:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243776 00000100:00100000:2.0:1788927418.909051:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 35 00000100:00100000:2.0:1788927418.909062:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053243776:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.923380:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:2.0:1788927418.923646:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053243776:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 14575us (15090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.923660:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 35 00000100:00100000:2.0:1788927418.933184:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.933294:0:6948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053243904 00000100:00100000:0.0:1788927418.933310:0:6948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053243904 00002000:00100000:0.0:1788927418.933386:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->19) req@ffff918977b34000 x1875826053243904/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/0 e 0 to 0 dl 1788927429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.933427:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b34000 with x1875826053243904 ext(0->19) 00002000:00010000:0.0:1788927418.933435:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918977b34000 00000100:00100000:0.0:1788927418.933476:0:6948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 19 00000100:00100000:0.0:1788927418.933489:0:6948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2363:x1875826053243904:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927418.935515:0:6948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2363:x1875826053243904:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 2015us (2333us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788927418.935541:0:6948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 19 00002000:00100000:0.0:1788927418.935555:0:6948:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->19) req@ffff918977b34000 x1875826053243904/t4294967318(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:229/0 lens 512/448 e 0 to 0 dl 1788927429 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927418.935566:0:6948:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b34000 with x1875826053243904 ext(0->19) 00002000:00010000:0.0:1788927418.935574:0:6948:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff918977b34000 00000100:00100000:0.0:1788927418.946748:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927418.946987:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053244032 00000100:00100000:2.0:1788927418.947001:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053244032 00000100:00100000:2.0:1788927418.947081:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00100000:2.0:1788927418.947094:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053244032:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.950639:0:6935:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1788927418.951038:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053244032:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 3929us (4288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927418.951054:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 36 00000100:00100000:1.0:1788927418.957873:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.957985:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053244288 00000100:00100000:0.0:1788927418.957998:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053244288 00000100:00100000:0.0:1788927418.958086:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 6 00000100:00100000:0.0:1788927418.958099:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:11329:x1875826053244288:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 00000001:00080000:0.0:1788927418.958654:0:5957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967311 00000001:00080000:0.0:1788927418.959036:0:5957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:0.0:1788927418.959176:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11329:x1875826053244288:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 Request processed in 1076us (1412us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788927418.959188:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 6 00000020:00080000:0.0:1788927418.959194:0:5957:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788927418.971644:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927418.971917:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053244416 00000100:00100000:1.0:1788927418.971930:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053244416 00000100:00100000:1.0:1788927418.972005:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 41 00000100:00100000:1.0:1788927418.972018:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918943708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11329:x1875826053244416:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788927418.972062:0:8589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927418.972092:0:8589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e9800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9aa expref: -99 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972183:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972202:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972220:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972260:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972275:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972282:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972340:0:8589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972348:0:8589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972356:0:8589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972362:0:8589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918951778800 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927418.972368:0:8589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972376:0:8589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972390:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:1.0:1788927418.972394:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927418.972400:0:8589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972406:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918951778800/0x750239bd504e9807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972485:0:8589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972499:0:8589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972504:0:8589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972510:0:8589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918943615a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927418.972513:0:8589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972520:0:8589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972529:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff91884393a500) 00010000:00010000:1.0:1788927418.972532:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927418.972535:0:8589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972541:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918943615a00/0x750239bd504e980e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972585:0:8589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e9800 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9aa expref: 12 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972653:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:1.0:1788927418.972656:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927418.972660:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918951779600/0x750239bd504e9800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9aa expref: 12 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927418.972671:0:8589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918951779600, rc 0) 00000100:00100000:0.0:1788927418.983129:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918943708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11329:x1875826053244416:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 11091us (11478us total) trans 0 rc 301/301 00000100:00100000:0.0:1788927418.983146:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 41 00000100:00100000:1.0:1788927418.992484:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927418.992674:0:5967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053244672 00000100:00100000:0.0:1788927418.992695:0:5967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053244672 00000100:00100000:0.0:1788927418.992893:0:5967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 0 00000100:00100000:0.0:1788927418.992908:0:5967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11329:x1875826053244672:12345-192.168.203.54@tcp:36:llapi_scan_chan.0 00010000:00010000:0.0:1788927418.992982:0:5967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927418.993020:0:5967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df400/0x750239bd504e97e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db99c expref: 11 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993056:0:5967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918971b59f00) 00010000:00010000:0.0:1788927418.993073:0:5967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788927418.993112:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993130:0:5967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993142:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993161:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993168:0:5967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993176:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993217:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993226:0:5967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993233:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993349:0:5967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993358:0:5967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.993365:0:5967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788927418.995230:0:5967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f5ce185 reply state 00000000c41b0c6b transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927418.995255:0:5967:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788927418.995269:0:5967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.995276:0:5967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.995284:0:5967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.995290:0:5967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480e00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927418.995320:0:5967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.995329:0:5967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.995349:0:5967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:0.0:1788927418.995352:0:5967:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927418.995358:0:5967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927418.995365:0:5967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9815 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788927418.995387:0:5967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f5ce185 reply state 00000000c41b0c6b transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927418.995394:0:5967:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:0.0:1788927418.995398:0:5967:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f5ce185 reply state 00000000c41b0c6b transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927418.995405:0:5967:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1788927418.995559:0:5967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+12:11329:x1875826053244672:12345-192.168.203.54@tcp:36:llapi_scan_chan.0 Request processed in 2648us (3084us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788927418.995570:0:5967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 0 00010000:00010000:3.0:1788927419.000675:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000702:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000712:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000719:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967481800 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927419.000725:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000735:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000758:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb1bed465 (ffff918949236000) 00010000:00010000:3.0:1788927419.000762:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927419.000767:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000797:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481800/0x750239bd504e9823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000827:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000833:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000839:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000844:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927419.000847:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000853:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000861:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff918949236e00) 00010000:00010000:3.0:1788927419.000869:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927419.000873:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000879:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480a00/0x750239bd504e981c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000894:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000900:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000913:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000920:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967481600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927419.000923:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000931:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000940:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918949236700) 00010000:00010000:3.0:1788927419.000943:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788927419.000946:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.000952:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481600/0x750239bd504e982a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.001486:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927419.001652:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053244800 00000100:00100000:3.0:1788927419.001665:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053244800 00000100:00100000:3.0:1788927419.001747:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 42 00000100:00100000:3.0:1788927419.001759:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9188449a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11329:x1875826053244800:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788927419.001794:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927419.001816:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9b1 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.001921:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.001937:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.001956:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.001974:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.001981:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.001987:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002098:0:5954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002106:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002114:0:5954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927419.002164:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 20 00000004:00200000:3.0:1788927419.002170:0:5954:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788927419.002192:0:5954:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002205:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002214:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002231:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002237:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002242:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820dfa00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927419.002246:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002253:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002264:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:3.0:1788927419.002266:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927419.002269:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002275:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfa00/0x750239bd504e9838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002287:0:5954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002293:0:5954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002298:0:5954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002301:0:5954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9189820df000 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:3.0:1788927419.002307:0:5954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002313:0:5954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002319:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff918971b59500) 00010000:00010000:3.0:1788927419.002322:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788927419.002324:0:5954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002330:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820df000/0x750239bd504e983f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002364:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e9831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9b1 expref: 13 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002376:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9b1 expref: 12 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.002384:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918971b59700) 00010000:00010000:3.0:1788927419.002386:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788927419.002389:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de600, rc 0) 00000100:00100000:3.0:1788927419.002466:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9188449a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+12:11329:x1875826053244800:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 708us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927419.002475:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 42 00000100:00100000:1.0:1788927419.016370:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.017062:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053245056 00000100:00100000:0.0:1788927419.017077:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053245056 00000100:00100000:2.0:1788927419.017273:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 43 00000100:00100000:2.0:1788927419.017287:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+12:11329:x1875826053245056:12345-192.168.203.54@tcp:36:llapi_scan_chan.0 00010000:00010000:2.0:1788927419.017360:0:5955:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788927419.017412:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de600/0x750239bd504e9846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9b1 expref: 12 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.017453:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918971b59700) 00010000:00010000:2.0:1788927419.017469:0:5955:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788927419.017500:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.017517:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.017542:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.017561:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.017569:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.017576:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.018152:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.018167:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.018176:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788927419.018497:0:5955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788927419.018947:0:5955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368143350189ns, next at 369143345699ns, rc = 0 00010000:00010000:2.0:1788927419.019076:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019091:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019101:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019110:0:5955:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019118:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019124:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019153:0:5955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788927419.019184:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019191:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019197:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019203:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6c00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927419.019208:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019227:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019240:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918942e73b00) 00010000:00010000:2.0:1788927419.019244:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788927419.019248:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019254:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6c00/0x750239bd504e985b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019273:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019278:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019284:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019289:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927419.019292:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019297:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019304:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:2.0:1788927419.019307:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927419.019310:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.019326:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6600/0x750239bd504e984d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788927419.019337:0:5955:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dcdf8d5 reply state 0000000094f347c4 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927419.019347:0:5955:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788927419.019463:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:11329:x1875826053245056:12345-192.168.203.54@tcp:36:llapi_scan_chan.0 Request processed in 2174us (3105us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788927419.019473:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 43 00010000:00010000:1.0:1788927419.019564:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788927419.019572:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.019579:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6e00 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:1.0:1788927419.019583:0:5942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.019589:0:5942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.019618:0:5942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff918942e73b00) 00010000:00010000:1.0:1788927419.019621:0:5942:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788927419.019624:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.019630:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e9862 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.019648:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927419.019649:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927419.019651:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927419.022117:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.022140:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.022150:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.022175:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927419.022181:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.022189:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.022207:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x53c112bd (ffff918942e73200) 00010000:00010000:1.0:1788927419.022211:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927419.022216:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.022223:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7a00/0x750239bd504e9854 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x53c112bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.039941:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927419.040082:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053245312 00000100:00100000:3.0:1788927419.040096:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053245312 00000100:00100000:3.0:1788927419.040177:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 44 00000100:00100000:3.0:1788927419.040195:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+12:11329:x1875826053245312:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788927419.040248:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927419.040277:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e9869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9b8 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788927419.040416:0:5954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788927419.040582:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e9869 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9b8 expref: 14 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.040655:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91894336ad00) 00010000:00010000:3.0:1788927419.040659:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788927419.040666:0:5954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e9869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9b8 expref: 14 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.040696:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820de400, rc 0) 00000100:00100000:3.0:1788927419.040785:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:11329:x1875826053245312:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 593us (919us total) trans 4294967316 rc 301/301 00000100:00100000:3.0:1788927419.040793:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 44 00000100:00100000:3.0:1788927419.058223:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927419.058371:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053245568 00000100:00100000:2.0:1788927419.058391:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053245568 00000100:00100000:2.0:1788927419.058534:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:2.0:1788927419.058548:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:11329:x1875826053245568:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 00000100:00100000:2.0:1788927419.058881:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11329:x1875826053245568:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 Request processed in 336us (672us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788927419.058889:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 7 00000100:00100000:3.0:1788927419.069888:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.069959:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053245696 00000100:00100000:0.0:1788927419.069970:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053245696 00000100:00100000:0.0:1788927419.070042:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 45 00000100:00100000:0.0:1788927419.070053:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884496ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11330:x1875826053245696:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788927419.070124:0:8589:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff91895830c6d8 00000040:00080000:0.0:1788927419.070182:0:8589:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788927419.070188:0:8589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1788927419.070215:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788927419.070224:0:8589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1788927419.070306:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884496ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11330:x1875826053245696:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 Request processed in 254us (432us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927419.070315:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 45 00000100:00100000:1.0:1788927419.098385:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.098542:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053245824 00000100:00100000:0.0:1788927419.098555:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053245824 00000100:00100000:0.0:1788927419.098672:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 46 00000100:00100000:0.0:1788927419.098686:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91884484c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11331:x1875826053245824:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788927419.098740:0:5956:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff91895830c800 00000040:00080000:0.0:1788927419.098790:0:5956:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788927419.098795:0:5956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1788927419.098823:0:5956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788927419.098832:0:5956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1788927419.099539:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91884484c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11331:x1875826053245824:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 Request processed in 223us (535us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927419.099555:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 46 00000100:00100000:3.0:1788927419.105204:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.105286:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053245952 00000100:00100000:0.0:1788927419.105305:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053245952 00000100:00100000:0.0:1788927419.105392:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 47 00000100:00100000:0.0:1788927419.105406:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11332:x1875826053245952:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788927419.105466:0:8589:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff91895830c928 00000040:00080000:0.0:1788927419.105521:0:8589:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788927419.105534:0:8589:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1788927419.105558:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788927419.105567:0:8589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1788927419.105701:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11332:x1875826053245952:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 Request processed in 297us (512us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927419.105715:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 47 00000100:00100000:3.0:1788927419.141284:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.141542:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053246080 00000100:00100000:0.0:1788927419.141555:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053246080 00000100:00100000:0.0:1788927419.142079:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 48 00000100:00100000:0.0:1788927419.142095:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11333:x1875826053246080:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 00000004:00000080:0.0:1788927419.142140:0:5954:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff91895830ca50 00000040:00080000:0.0:1788927419.142191:0:5954:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788927419.142197:0:5954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1788927419.142217:0:5954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788927419.142225:0:5954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1788927419.142307:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11333:x1875826053246080:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 Request processed in 216us (1038us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788927419.142315:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 48 00000100:00100000:1.0:1788927419.182937:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.183131:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053246336 00000100:00100000:0.0:1788927419.183142:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053246336 00000100:00100000:0.0:1788927419.183205:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 49 00000100:00100000:0.0:1788927419.183228:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:11335:x1875826053246336:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788927419.183856:0:8589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927419.183888:0:8589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9877 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9bf expref: -99 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.184555:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.184588:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.184622:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.184640:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.184647:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.184654:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788927419.185236:0:8589:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788927419.185415:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185427:0:8589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185435:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185476:0:8589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185483:0:8589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185491:0:8589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185506:0:8589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967481a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927419.185511:0:8589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185518:0:8589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185530:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:0.0:1788927419.185533:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927419.185538:0:8589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185544:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e987e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788927419.185558:0:8589:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a903ee65 reply state 000000006df24929 transno 4294967318 ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927419.185568:0:8589:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788927419.185650:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e9877 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 17 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185665:0:8589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 16 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.185688:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:0.0:1788927419.185691:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788927419.185693:0:8589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967481e00, rc 0) 00000100:00100000:0.0:1788927419.185770:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+17:11335:x1875826053246336:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 2545us (2842us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788927419.185786:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 49 00010000:00010000:0.0:1788927419.193808:0:3429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.193867:0:3429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.193904:0:3429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.193912:0:3429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918967480600 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:0.0:1788927419.193918:0:3429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.193928:0:3429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.193950:0:3429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37779e05 (ffff918949236600) 00010000:00010000:0.0:1788927419.193954:0:3429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788927419.193960:0:3429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.193967:0:3429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480600/0x750239bd504e9885 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.199839:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.200098:0:5957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053246592 00000100:00100000:0.0:1788927419.200111:0:5957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053246592 00000100:00100000:0.0:1788927419.200201:0:5957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 8 00000100:00100000:0.0:1788927419.200214:0:5957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+16:11335:x1875826053246592:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 00000001:00080000:0.0:1788927419.201083:0:5957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000100:00100000:0.0:1788927419.201256:0:5957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+18:11335:x1875826053246592:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 Request processed in 1041us (1430us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788927419.201267:0:5957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 8 00000020:00080000:0.0:1788927419.203898:0:5957:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788927419.208038:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927419.208959:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053246848 00000100:00100000:1.0:1788927419.208974:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053246848 00000100:00100000:1.0:1788927419.209058:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 50 00000100:00100000:1.0:1788927419.209070:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894979bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+18:11335:x1875826053246848:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788927419.209102:0:5956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927419.209128:0:5956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918943615200/0x750239bd504e989a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9c6 expref: -99 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.209257:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.209289:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.209302:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.209318:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.209325:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.209332:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788927419.215905:0:5956:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788927419.216192:0:5956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff918943615000/0x750239bd504e98af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216215:0:5956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918943615000/0x750239bd504e98af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216229:0:5956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918943615000/0x750239bd504e98af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216276:0:5956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216285:0:5956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216293:0:5956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216312:0:5956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918943614200 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927419.216317:0:5956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216326:0:5956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216341:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:1.0:1788927419.216345:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927419.216351:0:5956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216358:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918943614200/0x750239bd504e98a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788927419.216376:0:5956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006974da1a reply state 00000000118e3610 transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.216387:0:5956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788927419.216437:0:5956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918943615200/0x750239bd504e989a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9c6 expref: 21 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216454:0:5956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918943615000/0x750239bd504e98af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9c6 expref: 20 pid: 5956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.216463:0:5956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91884393ad00) 00010000:00010000:1.0:1788927419.216466:0:5956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788927419.216469:0:5956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918943615000, rc 0) 00000100:00100000:1.0:1788927419.216568:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894979bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+21:11335:x1875826053246848:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 7499us (8553us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788927419.216591:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 50 00010000:00010000:1.0:1788927419.221395:0:3430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.221423:0:3430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.221433:0:3430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.221440:0:3430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918943615400 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:1.0:1788927419.221447:0:3430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.221456:0:3430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.221480:0:3430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7b008030 (ffff91884393a500) 00010000:00010000:1.0:1788927419.221483:0:3430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788927419.221489:0:3430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.221496:0:3430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918943615400/0x750239bd504e98a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b008030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927419.233533:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927419.233847:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053247104 00000100:00100000:2.0:1788927419.233861:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053247104 00000100:00100000:2.0:1788927419.233939:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 9 00000100:00100000:2.0:1788927419.233953:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+20:11335:x1875826053247104:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 00000001:00080000:2.0:1788927419.234332:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788927419.234591:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+22:11335:x1875826053247104:12345-192.168.203.54@tcp:35:llapi_scan_chan.0 Request processed in 638us (1069us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788927419.234656:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 9 00000020:00080000:2.0:1788927419.234914:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788927419.243444:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.243764:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053247360 00000100:00100000:0.0:1788927419.243778:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053247360 00000100:00100000:0.0:1788927419.243858:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 51 00000100:00100000:0.0:1788927419.243870:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894979a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+22:11335:x1875826053247360:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788927419.243904:0:8589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927419.243931:0:8589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e98bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9cd expref: -99 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.244096:0:8589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.244113:0:8589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 23 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.244124:0:8589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.244699:0:8589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 23 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.244883:0:8589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 23 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927419.244903:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894370bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8589:1875826075296640:192.168.203.54@tcp:104: 00000100:00100000:0.0:1788927419.245108:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff918844a4ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788927419.263877:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.264228:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894370bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8589:1875826075296640:192.168.203.54@tcp:104: 00010000:00010000:0.0:1788927419.264265:0:8589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927419.264706:0:8019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053247488 00000100:00100000:3.0:1788927419.264715:0:8019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053247488 00010000:00010000:3.0:1788927419.264765:0:8019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 24 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927419.264823:0:8019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 29 00000100:00100000:3.0:1788927419.264835:0:8019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+24:2361:x1875826053247488:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788927419.264855:0:8019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788927419.264864:0:8019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 24 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.264877:0:8019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 24 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.264903:0:8019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481e00/0x750239bd504e988c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9bf expref: 24 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.264921:0:8019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:3.0:1788927419.264925:0:8019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.264934:0:8019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.264941:0:8019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.264977:0:8019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788927419.265096:0:8019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+23:2361:x1875826053247488:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 263us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927419.265106:0:8019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 29 00010000:00010000:1.0:1788927419.266013:0:8589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.266037:0:8589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8589 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788927419.266078:0:8589:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788927419.266253:0:8589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967480e00/0x750239bd504e98bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 24 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.266272:0:8589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 23 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.266280:0:8589:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:1.0:1788927419.266283:0:8589:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788927419.266286:0:8589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967481a00, rc 0) 00000100:00100000:1.0:1788927419.266344:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894979a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+23:11335:x1875826053247360:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 22476us (22917us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788927419.266352:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 51 00000100:00100000:3.0:1788927419.280899:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.281088:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053247616 00000100:00100000:0.0:1788927419.281103:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053247616 00000100:00100000:0.0:1788927419.281180:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 52 00000100:00100000:0.0:1788927419.281192:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894979a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+23:11335:x1875826053247616:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:0.0:1788927419.281225:0:5954:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788927419.281251:0:5954:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff918967480800/0x750239bd504e98d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9d4 expref: -99 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.281341:0:5954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff918967480800/0x750239bd504e98d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9d4 expref: 24 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.281357:0:5954:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff918967480800/0x750239bd504e98d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9d4 expref: 24 pid: 5954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.281376:0:5954:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:0.0:1788927419.281380:0:5954:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788927419.281385:0:5954:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918967480800, rc 0) 00000100:00100000:0.0:1788927419.281478:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894979a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+24:11335:x1875826053247616:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 287us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927419.281484:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 52 00010000:00010000:0.0:1788927419.292325:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788927419.292991:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927419.293117:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053247744 00000100:00100000:1.0:1788927419.293132:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053247744 00000100:00100000:1.0:1788927419.293231:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 37 00000100:00100000:1.0:1788927419.293246:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:11335:x1875826053247744:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:1.0:1788927419.293281:0:6943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788927419.293317:0:6943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f2151c/0x750239bd504e98d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9db expref: -99 pid: 6943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788927419.293349:0:6943:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788927419.293380:0:6943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1788927419.293385:0:6943:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788927419.293395:0:6943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f2151c/0x750239bd504e98d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9db expref: 6 pid: 6943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.293850:0:6943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4f2151c/0x750239bd504e98d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9db expref: 6 pid: 6943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.293867:0:6943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff918943615200, rc 0) 00000100:00100000:1.0:1788927419.293941:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:11335:x1875826053247744:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 699us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927419.293950:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 37 00000100:00080000:0.0:1788927419.294083:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788927419.310064:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927419.310907:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053247872 00000100:00100000:3.0:1788927419.310921:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053247872 00000100:00100000:3.0:1788927419.311007:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 53 00000100:00100000:3.0:1788927419.311021:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+24:11335:x1875826053247872:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:3.0:1788927419.311057:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788927419.311082:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e98e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9e2 expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.311127:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e98e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.311146:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e98e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.311159:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e98e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.311330:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9189820de400/0x750239bd504e98e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9e2 expref: 26 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.311354:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9189820dfc00/0x750239bd504e98e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9e2 expref: 25 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788927419.311364:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:3.0:1788927419.311368:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788927419.311371:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9189820dfc00, rc 0) 00000100:00100000:3.0:1788927419.311591:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+25:11335:x1875826053247872:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 572us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927419.311658:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 53 00000100:00100000:2.0:1788927419.326082:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.326859:0:6946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248000 00000100:00100000:0.0:1788927419.326872:0:6946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248000 00002000:00100000:0.0:1788927419.326959:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->0) req@ffff918977b34a80 x1875826053248000/t0(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:230/0 lens 496/0 e 0 to 0 dl 1788927430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927419.326974:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b34a80 with x1875826053248000 ext(0->0) 00002000:00010000:0.0:1788927419.326981:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff918977b34a80 00000100:00100000:0.0:1788927419.327072:0:6946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 20 00000100:00100000:0.0:1788927419.327085:0:6946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053248000:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 00000100:00100000:0.0:1788927419.328901:0:6946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2361:x1875826053248000:12345-192.168.203.54@tcp:4:llapi_scan_chan.0 Request processed in 1808us (2824us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788927419.328915:0:6946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 20 00002000:00100000:0.0:1788927419.328928:0:6946:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->0) req@ffff918977b34a80 x1875826053248000/t4294967301(0) o4->20893ea2-62f1-4ff2-a5ab-c8ef32fae354@192.168.203.54@tcp:230/0 lens 496/448 e 0 to 0 dl 1788927430 ref 1 fl Complete:/600/0 rc 0/0 job:'llapi_scan_chan.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788927419.328939:0:6946:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff918977b34a80 with x1875826053248000 ext(0->0) 00002000:00010000:0.0:1788927419.328945:0:6946:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff918977b34a80 00000100:00100000:2.0:1788927419.338504:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927419.339196:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248128 00000100:00100000:3.0:1788927419.339211:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248128 00000100:00100000:3.0:1788927419.339317:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 54 00000100:00100000:3.0:1788927419.339331:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+25:11335:x1875826053248128:12345-192.168.203.54@tcp:44:llapi_scan_chan.0 00000001:00080000:2.0:1788927419.349982:0:5933:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00000004:00080000:2.0:1788927419.350080:0:5933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788927419.351405:0:3444:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788927419.351440:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075296768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788927419.351542:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927419.352119:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075296768 00000100:00100000:1.0:1788927419.352130:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075296768 00000100:00100000:1.0:1788927419.352213:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788927419.352224:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3444:x1875826075296768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788927419.352261:0:6942:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:1.0:1788927419.352408:0:6942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.355872:0:6942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 5 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.355897:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788927419.355903:0:6942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788927419.355910:0:6942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.355981:0:6942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 5 pid: 6941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.356043:0:6942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 5 pid: 6941 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.356065:0:6942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894593fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6942:1875826075296896:192.168.203.54@tcp:104: 00000100:00100000:1.0:1788927419.356191:0:6942:0:(client.c:2715:ptlrpc_set_wait()) set ffff918944d86cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788927419.356828:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788927419.366213:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.367039:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11335:x1875826053248128:12345-192.168.203.54@tcp:44:llapi_scan_chan.0 Request processed in 27698us (34003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927419.367053:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 54 00000100:00100000:1.0:1788927419.368847:0:5941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248256 00000100:00100000:1.0:1788927419.368868:0:5941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248256 00010000:00010000:1.0:1788927419.368927:0:5941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 6 pid: 6941 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.368980:0:5941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 30 00000100:00100000:1.0:1788927419.368992:0:5941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053248256:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788927419.369011:0:5941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788927419.369019:0:5941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 6 pid: 6941 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369118:0:5941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 6 pid: 6941 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369153:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788927419.369159:0:5941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788927419.369166:0:5941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369203:0:5941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369230:0:5941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788927419.369288:0:5941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2361:x1875826053248256:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 299us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927419.369296:0:5941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 30 00010000:00010000:1.0:1788927419.369371:0:6942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000901f2da7/0x750239bd504e97f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9a3 expref: 5 pid: 6941 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788927419.369389:0:6942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6942:1875826075296896:192.168.203.54@tcp:104: 00010000:00010000:1.0:1788927419.369413:0:6942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369425:0:6942:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369433:0:6942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369445:0:6942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369530:0:6942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369559:0:6942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788927419.369576:0:5942:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788927419.369583:0:5942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369592:0:5942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff918943614200 already unused, calling callback (ffffffffc0d6d230) 00010000:00010000:1.0:1788927419.369728:0:5942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369741:0:5942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369755:0:5942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369763:0:5942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4080004/0x750239bd504e98ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788927419.369782:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927419.369785:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788927419.369786:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927419.369926:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3444:x1875826075296768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17702us (18381us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788927419.369938:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:1.0:1788927419.369957:0:3444:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91894593dc00/2, rc 0, transno 4294967319 00000100:00100000:1.0:1788927419.369966:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894593dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075296768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788927419.377511:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:3.0:1788927419.377897:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248384 00000100:00100000:3.0:1788927419.377910:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248384 00000100:00100000:3.0:1788927419.378017:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 39 00000100:00100000:3.0:1788927419.378041:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+8:2360:x1875826053248384:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 00000001:00080000:2.0:1788927419.380136:0:8011:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788927419.380358:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053248384:12345-192.168.203.54@tcp:16:llapi_scan_chan.0 Request processed in 2323us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927419.380372:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 39 00000100:00100000:3.0:1788927419.393180:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927419.393437:0:5955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248512 00000100:00100000:2.0:1788927419.393449:0:5955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248512 00000100:00100000:2.0:1788927419.393531:0:5955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 55 00000100:00100000:2.0:1788927419.393544:0:5955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+11:11335:x1875826053248512:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 00010000:00010000:2.0:1788927419.393573:0:5955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788927419.393646:0:5955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e98f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5b0f85aecd8db9e9 expref: -99 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394115:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394132:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394146:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394164:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394172:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394200:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394295:0:5955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394307:0:5955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 12 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394317:0:5955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394358:0:5955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 12 pid: 8589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.394375:0:5955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 12 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788927419.394391:0:5955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5955:1875826075297024:192.168.203.54@tcp:104: 00000100:00100000:2.0:1788927419.395350:0:5955:0:(client.c:2715:ptlrpc_set_wait()) set ffff918944b73480 going to sleep for 11 seconds 00000100:00100000:0.0:1788927419.400310:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927419.400472:0:5955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918977b36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5955:1875826075297024:192.168.203.54@tcp:104: 00010000:00010000:2.0:1788927419.400509:0:5955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788927419.400810:0:5958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248768 00000100:00100000:3.0:1788927419.400821:0:5958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248768 00000100:00100000:3.0:1788927419.400887:0:5958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 10 00000100:00100000:3.0:1788927419.400899:0:5958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918949a88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:5449:x1875826053248768:12345-192.168.203.54@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1788927419.401243:0:5958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:3.0:1788927419.401374:0:5958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949a88450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+15:5449:x1875826053248768:12345-192.168.203.54@tcp:35:ldlm_bl.0 Request processed in 476us (1080us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788927419.401381:0:5958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 10 00000020:00080000:3.0:1788927419.401386:0:5958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788927419.406972:0:3436:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:0.0:1788927419.407088:0:5939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053248896 00000100:00100000:0.0:1788927419.407115:0:5939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053248896 00010000:00010000:0.0:1788927419.407166:0:5939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 15 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788927419.407214:0:5939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 31 00000100:00100000:0.0:1788927419.407224:0:5939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+15:2360:x1875826053248896:12345-192.168.203.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788927419.407243:0:5939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788927419.407250:0:5939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 15 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.407267:0:5939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 15 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.407294:0:5939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff918967481a00/0x750239bd504e98c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9cd expref: 15 pid: 8589 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.407315:0:5939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:0.0:1788927419.407320:0:5939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.407332:0:5939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.407341:0:5939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788927419.407381:0:5939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788927419.407760:0:5939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+14:2360:x1875826053248896:12345-192.168.203.54@tcp:103:ldlm_bl.0 Request processed in 533us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927419.407779:0:5939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 31 00010000:00010000:2.0:1788927419.407897:0:5955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.407919:0:5955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788927419.407987:0:5955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 1 00000004:00200000:2.0:1788927419.407992:0:5955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788927419.408015:0:5955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408039:0:5955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408051:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408058:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408066:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408073:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c6a00 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927419.408078:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408086:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408096:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff918971b59800) 00010000:00010000:2.0:1788927419.408099:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927419.408103:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408120:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6a00/0x750239bd504e98fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408134:0:5955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408140:0:5955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408146:0:5955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408151:0:5955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9188448c7800 already unused, calling callback (ffffffffc197a4f0) 00010000:00010000:2.0:1788927419.408154:0:5955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408160:0:5955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408169:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37779e05 (ffff91884463ae00) 00010000:00010000:2.0:1788927419.408171:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788927419.408175:0:5955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408181:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7800/0x750239bd504e9903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x37779e05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408224:0:5955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c6e00/0x750239bd504e98f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9e9 expref: 14 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408239:0:5955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9188448c7600/0x750239bd504e990a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.54@tcp remote: 0x5b0f85aecd8db9e9 expref: 13 pid: 5955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788927419.408255:0:5955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff918949236900) 00010000:00010000:2.0:1788927419.408258:0:5955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788927419.408261:0:5955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9188448c7600, rc 0) 00000100:00100000:2.0:1788927419.408291:0:5955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918949799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:11335:x1875826053248512:12345-192.168.203.54@tcp:101:llapi_scan_chan.0 Request processed in 14750us (15128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927419.408299:0:5955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 55 00000100:00100000:2.0:1788927419.416017:0:3438:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927419.416131:0:5956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053249024 00000100:00100000:1.0:1788927419.416144:0:5956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053249024 00000100:00100000:1.0:1788927419.416315:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 56 00000100:00100000:1.0:1788927419.416328:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918977b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:11335:x1875826053249024:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 00000004:00000080:1.0:1788927419.416376:0:5956:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=403066b3 len=48 karg=ffff91895830dac0 00000040:00080000:1.0:1788927419.418065:0:5956:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788927419.418076:0:5956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1788927419.418109:0:5956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788927419.418120:0:5956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1788927419.418234:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918977b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:11335:x1875826053249024:12345-192.168.203.54@tcp:53:llapi_scan_chan.0 Request processed in 1903us (2225us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788927419.418247:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 56 00000100:00100000:1.0:1788927419.918938:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927419.919000:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927419.919052:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:1.0:1788927419.919105:0:3437:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.54@tcp (source: 12345-192.168.203.54@tcp) 00000100:00100000:2.0:1788927419.919132:0:6942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053249536 00000100:00100000:1.0:1788927419.919149:0:6943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053249408 00000100:00100000:2.0:1788927419.919151:0:6942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053249536 00000100:00100000:1.0:1788927419.919162:0:6943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053249408 00000100:00100000:2.0:1788927419.919254:0:6942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 41 00000100:00100000:3.0:1788927419.919269:0:5948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053249152 00000100:00100000:2.0:1788927419.919273:0:6942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053249536:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:3.0:1788927419.919276:0:5948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053249152 00000100:00100000:3.0:1788927419.919329:0:5948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 248 00000100:00100000:3.0:1788927419.919340:0:5948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053249152:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:2.0:1788927419.919389:0:6942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+6:2360:x1875826053249536:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 122us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788927419.919400:0:6942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 41 00000100:00100000:3.0:1788927419.919428:0:5948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24092ab7-bf87-4b0f-8781-22219a15f18b+10:2360:x1875826053249152:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 87us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927419.919437:0:5948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 248 00000100:00100000:0.0:1788927419.919479:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826053249280 00000100:00100000:0.0:1788927419.919487:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826053249280 00000100:00100000:0.0:1788927419.919554:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 121 00000100:00100000:0.0:1788927419.919565:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894593fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:2360:x1875826053249280:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:0.0:1788927419.919662:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894593fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+13:2360:x1875826053249280:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 97us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927419.919672:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 121 00000100:00100000:1.0:1788927419.922330:0:6943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.54@tcp, seq: 42 00000100:00100000:1.0:1788927419.922364:0:6943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053249408:12345-192.168.203.54@tcp:400:kworker.0 00000100:00100000:1.0:1788927419.922460:0:6943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20893ea2-62f1-4ff2-a5ab-c8ef32fae354+5:2360:x1875826053249408:12345-192.168.203.54@tcp:400:kworker.0 Request processed in 117us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927419.922467:0:6943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.54@tcp, seq: 42 00010000:00010000:0.0:1788927420.315806:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788927421.020536:0:3444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918943709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075297152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788927421.020634:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927421.021626:0:6945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297152 00000100:00100000:0.0:1788927421.021634:0:6945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297152 00000100:00100000:0.0:1788927421.021699:0:6945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788927421.021708:0:6945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1875826075297152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788927421.021738:0:6945:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176898624 pending 0 free 3923668992 avail 3692146688 00000100:00100000:0.0:1788927421.021806:0:6945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3444:x1875826075297152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927421.021812:0:6945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788927421.021861:0:3444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918943709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3444:1875826075297152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788927421.025366:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788927421.286281:0:12479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_157d: @@@@@@ FAIL: llapi_scan_changelog_test failed 00010000:00010000:2.0:1788927421.341476:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788927421.531217:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075297408:0@lo:400:kworker.0 00000100:00100000:1.0:1788927421.531263:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918943709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075297280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788927421.531414:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927421.531481:0:3445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075297792:0@lo:400:kworker.0 00000100:00100000:1.0:1788927421.531518:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788927421.531568:0:8592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297280 00000100:00100000:1.0:1788927421.531577:0:8592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297280 00000100:00100000:1.0:1788927421.531662:0:8592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788927421.531674:0:8592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075297280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788927421.531716:0:8592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125952 pending 0 free 3923664896 avail 3692142592 00000100:00100000:1.0:1788927421.531769:0:8592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3445:x1875826075297280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927421.531777:0:8592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788927421.531800:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788927421.532158:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918943709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3445:1875826075297280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788927421.532308:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927421.532359:0:3446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844ad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788927421.532527:0:5947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297408 00000100:00100000:1.0:1788927421.532533:0:5947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297408 00000100:00100000:1.0:1788927421.532580:0:5947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788927421.532590:0:5947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075297408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927421.532682:0:5954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297792 00000100:00100000:3.0:1788927421.532688:0:5954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297792 00000100:00100000:1.0:1788927421.532691:0:5947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91894887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3b70cda-d4d0-488a-a813-7f141061abda+19:3446:x1875826075297408:12345-0@lo:400:kworker.0 Request processed in 102us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788927421.532702:0:5947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788927421.532748:0:5954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788927421.532758:0:5954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91897dd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075297792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788927421.532816:0:5954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91897dd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3445:x1875826075297792:12345-0@lo:400:kworker.0 Request processed in 60us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927421.532823:0:5954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788927421.532847:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788927421.532850:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788927421.532874:0:6941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297920 00000100:00100000:3.0:1788927421.532878:0:6941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297920 00000100:00100000:0.0:1788927421.532892:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3b70cda-d4d0-488a-a813-7f141061abda:3446:1875826075297408:0@lo:400:kworker.0 00000100:00100000:0.0:1788927421.532923:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91894370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075297536:0@lo:400:kworker.0 00000100:00100000:3.0:1788927421.532968:0:6941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788927421.532980:0:6941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075297920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927421.532981:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927421.533021:0:3443:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788927421.533030:0:3443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff918844ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075297664:0@lo:400:kworker.0 00000100:00100000:3.0:1788927421.533044:0:6941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3446:x1875826075297920:12345-0@lo:400:kworker.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927421.533053:0:6941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788927421.533061:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788927421.533115:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297536 00000100:00100000:0.0:1788927421.533119:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297536 00000100:00100000:0.0:1788927421.533150:0:8589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875826075297664 00000100:00100000:0.0:1788927421.533154:0:8589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875826075297664 00000100:00100000:3.0:1788927421.533167:0:5956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788927421.533175:0:5956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075297536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927421.533191:0:8589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788927421.533202:0:8589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff918844ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075297664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788927421.533257:0:8589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3443:x1875826075297664:12345-0@lo:400:kworker.0 Request processed in 57us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788927421.533264:0:8589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788927421.533270:0:5956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff918844ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3443:x1875826075297536:12345-0@lo:400:kworker.0 Request processed in 40us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788927421.533279:0:5956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788927421.533289:0:5950:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788927421.533312:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3443:1875826075297664:0@lo:400:kworker.0 00000100:00100000:3.0:1788927421.533320:0:3443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91894370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3443:1875826075297536:0@lo:400:kworker.0 00000100:00100000:3.0:1788927421.533782:0:3446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844ad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3446:1875826075297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788927421.533989:0:3445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff918844ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3445:1875826075297792:0@lo:400:kworker.0 00010000:00010000:0.0:1788927422.362885:0:5943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788927423.386920:0:5942:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 11015 lines, 11015 kept, 0 dropped, 0 bad.