00000001:02000400:3.0F:1785389749.382156:0:2961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_hostid 00000001:02000400:3.0:1785389780.021255:0:3183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1785389782.183472:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 371 MB/s 00000001:01000000:2.0F:1785389782.433893:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 394 MB/s 00000001:01000000:2.0:1785389782.686176:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2392 MB/s 00000020:02000000:0.0F:1785389784.071682:0:3275:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_2_gcea94ac 00000400:02000000:3.0:1785389785.702315:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.154@tcp [8/256/0/180] 00008000:02000000:0.0:1785389790.629051:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1785389859.653717:0:5246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1785389873.263953:0:5784:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785389873.263959:0:5784:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1785389873.264094:0:5784:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000066afedaa 00000080:02000400:3.0:1785389873.264107:0:5784:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1785389873.273431:0:5784:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1785389873.273506:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785389873.273593:0:5784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000edb19e4a) 00000020:00000080:3.0:1785389873.273622:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785389873.344384:0:5784:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1785389873.346302:0:5784:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1785389873.496708:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1785389873.499562:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1785389873.499592:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1785389873.499647:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1785389873.499674:0:5784:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1785389873.500398:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1785389873.500407:0:5784:0:(osd_handler.c:1572:osd_obd_connect()) connect #0 00000020:00000080:0.0:1785389873.500421:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ec938 00000020:01000004:0.0:1785389873.500430:0:5784:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1785389873.500436:0:5784:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1785389873.501784:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000066afedaa from MGS 00000020:01000004:0.0:1785389873.501795:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1785389873.501842:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000486921f5) 00000020:00000080:0.0:1785389873.501865:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1785389873.502378:0:5784:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000066afedaa from MGS, refs=2 00080000:01000000:0.0:1785389873.502387:0:5784:0:(osd_handler.c:1572:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785389873.502394:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ec946 00000100:00100000:0.0:1785389873.502614:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1785389873.503848:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1785389873.503858:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1785389873.515592:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1785389873.515609:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1785389873.534409:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785389873.535753:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1785389873.535762:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1785389873.550555:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1785389873.550573:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1785389873.561634:0:5784:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1785389873.561653:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1785389873.562493:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389873.562497:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389873.562498:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389873.562819:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389873.562821:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389873.562823:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389873.563435:0:5784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1785389873.575836:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1785389873.818288:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1007 MB/s 00000001:01000000:2.0:1785389874.068690:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1199 MB/s 00000001:01000000:2.0:1785389874.319379:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 247 MB/s 00000001:01000000:3.0:1785389874.572156:0:5784:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 363 MB/s 00010000:00010000:2.0:1785389874.583453:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1785389874.600399:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1785389874.664054:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1785389874.664081:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1785389874.664084:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1785389874.673244:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1785389874.673875:0:5784:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1785389874.674116:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1785389874.674686:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1785389874.674719:0:5784:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1785389874.679135:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785389874.681148:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1785389874.681160:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1785389874.698030:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1785389874.698046:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1785389874.707748:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1785389874.707787:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1785389874.713192:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1785389874.713221:0:5784:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.154@tcp' 00000020:01000004:1.0:1785389874.713223:0:5784:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1785389874.713284:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.154@tcp (typ=mgc) 00000020:00000080:1.0:1785389874.713325:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.154@tcp (0000000065699f1c) 00000020:00000080:1.0:1785389874.713351:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1785389874.716760:0:5799:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1785389874.717680:0:5784:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008835c320@MGC192.168.202.154@tcp: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1785389874.717910:0:5784:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.154@tcp-0 is initialized 00000040:01000000:1.0:1785389874.717918:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 1 is initialized 10000000:01000000:3.0:1785389874.723510:0:5800:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1785389874.724075:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.154@tcp (uuid 19ebcf8f-53c9-4fee-a69e-b0198873419f) 00000020:00000080:1.0:1785389874.724102:0:5784:0:(genops.c:1406:class_connect()) connect: client 19ebcf8f-53c9-4fee-a69e-b0198873419f, cookie 0x33dffe75ff5ec954 00000100:00080000:1.0:1785389874.724113:0:5784:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785389874.724117:0:5784:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import 000000008835c320 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1785389874.724183:0:5784:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000000bfd61a x1872116879196288/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785389874.724306:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000000bfd61a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ebcf8f-53c9-4fee-a69e-b0198873419f:3306:1872116879196288:0@lo:250: 00000100:00100000:1.0:1785389874.724406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389874.724474:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879196288 00000100:00100000:1.0:1785389874.724480:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879196288 00000100:00100000:1.0:1785389874.724509:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785389874.724514:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015dcb576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1872116879196288:12345-0@lo:250: 00010000:00080000:1.0:1785389874.724551:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 19ebcf8f-53c9-4fee-a69e-b0198873419f@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1785389874.724573:0:5795:0:(genops.c:1406:class_connect()) connect: client 19ebcf8f-53c9-4fee-a69e-b0198873419f, cookie 0x33dffe75ff5ec95b 00000100:00080000:1.0:1785389874.724697:0:5795:0:(import.c:65:import_set_state_nolock()) 0000000046f69eb0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785389874.724742:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015dcb576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:3306:x1872116879196288:12345-0@lo:250: Request processed in 227us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389874.724757:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785389874.724787:0:3306:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1785389874.724794:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1785389874.724800:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1785389874.724803:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1785389874.724806:0:3306:0:(import.c:65:import_set_state_nolock()) 000000008835c320 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1785389874.724808:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1785389874.724818:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1785389874.724822:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000000bfd61a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ebcf8f-53c9-4fee-a69e-b0198873419f:3306:1872116879196288:0@lo:250: 00000100:00080000:1.0:1785389874.724849:0:5784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS 00000020:01000004:1.0:1785389874.724865:0:5784:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1785389874.724870:0:5784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1785389874.724883:0:5784:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000259ec055) 00000020:00000080:1.0:1785389874.724893:0:5784:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1785389874.758056:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785389874.758440:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1785389874.758447:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1785389874.762405:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1785389874.762429:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1785389874.763169:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1785389874.763177:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1785389874.785675:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785389874.786471:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1785389874.786480:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1785389874.795768:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1785389874.795786:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1785389874.883039:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785389874.883229:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1785389874.883235:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1785389874.884434:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1785389874.884442:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1785389874.885005:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785389874.885132:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785389874.885137:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1785389874.892549:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785389874.892564:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1785389874.893337:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785389874.893505:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1785389874.893509:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1785389874.894027:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785389874.894034:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1785389874.894963:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785389874.895100:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1785389874.895105:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1785389874.902279:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785389874.902294:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1785389874.942039:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785389874.942239:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1785389874.942246:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1785389874.950239:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1785389874.950254:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1785389874.952269:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785389874.952284:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1785389874.965173:0:5784:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1785389874.965209:0:5784:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1785389874.965215:0:5784:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1785389874.965354:0:5784:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1785389874.965386:0:5784:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1785389874.965391:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1785389874.965392:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785389874.965394:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785389874.965395:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785389874.965396:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785389874.965397:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785389874.965399:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785389874.965400:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785389874.965401:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785389874.965403:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785389874.965404:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785389874.965405:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785389874.965408:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1785389874.965410:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785389874.965411:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1785389874.965412:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785389874.965413:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785389874.965415:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785389874.965416:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785389874.965416:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1785389874.965418:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1785389874.965419:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785389874.965420:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785389874.965421:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785389874.965422:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785389874.965458:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1785389874.965475:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f1a37fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196416:0@lo:253: 00000100:00100000:0.0:1785389874.965678:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389874.967172:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e2e7b81c going to sleep for 11 seconds 00000100:00100000:2.0:1785389874.971457:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879196416 00000100:00100000:2.0:1785389874.971472:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879196416 00000100:00100000:2.0:1785389874.971565:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785389874.971575:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d25e0e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:5784:x1872116879196416:12345-0@lo:253: 20000000:01000000:2.0:1785389874.971630:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785389874.971634:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1785389874.972090:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1785389874.972162:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1785389874.972460:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785389874.973431:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1785389874.973681:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785389874.973685:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1785389874.973690:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1785389874.973693:0:5798:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1785389874.973707:0:5798:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1785389874.973881:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785389874.974137:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1785389874.974150:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1785389874.974202:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1785389874.974252:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1785389874.974430:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1785389874.974554:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1785389874.974564:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1785389874.974615:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1785389874.974624:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1785389874.974674:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1785389874.974683:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1785389874.974716:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1785389874.974768:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1785389874.974807:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1785389874.974812:0:5798:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1785389874.974826:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785389874.975055:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1785389874.975066:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1785389874.975104:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1785389874.975156:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1785389874.975209:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1785389874.975222:0:5798:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1785389874.975309:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1785389874.975319:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1785389874.975368:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1785389874.975406:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1785389874.975442:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1785389874.975452:0:5798:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1785389874.975573:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1785389874.975583:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1785389874.975620:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1785389874.975660:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1785389874.975833:0:5798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1785389874.975882:0:5798:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1785389874.975889:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1785389874.982498:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1785389874.985809:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1785389874.985838:0:5798:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.154@tcp for mdt 20000000:01000000:2.0:1785389874.985841:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:2.0:1785389874.985878:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1785389874.985887:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1785389874.985945:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1785389874.985953:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1785389874.986002:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1785389874.986013:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1785389874.986048:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1785389874.986097:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1785389874.986166:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785389874.986169:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785389874.986173:0:5798:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785389874.986183:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785389874.986185:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785389874.986211:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1785389874.986213:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785389874.992661:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1785389875.000406:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1785389875.000464:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1785389875.000732:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1785389875.000751:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1785389875.000754:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1785389875.001335:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1785389875.001795:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1785389875.001839:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1785389875.001877:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1785389875.001892:0:5798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785389875.001894:0:5798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1785389875.001899:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1785389875.001901:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1785389875.001907:0:5798:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1785389875.001912:0:5798:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1785389875.005771:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1785389875.009831:0:5798:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1785389875.034025:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1785389875.034076:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1785389875.034189:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1785389875.034212:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1785389875.034232:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034248:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034259:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034265:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034270:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034277:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034282:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000105fdfb8 already unused, calling callback (0000000088e6a38f) 00010000:00010000:2.0:1785389875.034285:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034305:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034318:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034324:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.034330:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec969 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1785389875.034348:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1785389875.469270:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d25e0e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:5784:x1872116879196416:12345-0@lo:253: Request processed in 497691us (503586us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389875.469286:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785389875.469517:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f1a37fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196416:0@lo:253: 10000000:01000000:1.0:1785389875.469574:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785389875.469578:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785389875.469581:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785389875.469594:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389875.469595:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1785389875.469597:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389875.469598:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389875.469599:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785389875.469601:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785389875.469602:0:5784:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1785389875.469604:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389875.469605:0:5784:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785389875.469622:0:5784:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000066afedaa from lustre-MDT0000 10000000:01000000:1.0:1785389875.469645:0:5784:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1785389875.469647:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785389875.469651:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cf50ddfb380 10000000:01000000:1.0:1785389875.469655:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785389875.469661:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf50ddfb380 from 1 10000000:01000000:1.0:1785389875.469664:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785389875.469698:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389875.469707:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389875.469716:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389875.469734:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000000bfd61a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196544:0@lo:101: 00000100:00100000:1.0:1785389875.469772:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389875.469881:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879196544 00000100:00100000:3.0:1785389875.469889:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879196544 00000100:00100000:3.0:1785389875.469922:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785389875.469929:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9852c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:5784:x1872116879196544:12345-0@lo:101: 00010000:00010000:3.0:1785389875.469942:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389875.469955:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ffdae1e/0x33dffe75ff5ec977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ec970 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.469976:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ffdae1e/0x33dffe75ff5ec977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.469997:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ffdae1e/0x33dffe75ff5ec977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.470006:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ffdae1e, rc 0) 00000100:00100000:3.0:1785389875.470033:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9852c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+6:5784:x1872116879196544:12345-0@lo:101: Request processed in 105us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389875.470040:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785389875.470429:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000001edd0f23 going to sleep for 11 seconds 00000100:00100000:1.0:1785389875.470445:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000000bfd61a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196544:0@lo:101: 00010000:00010000:1.0:1785389875.470457:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389875.470464:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389875.470516:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000000bfd61a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196672:0@lo:501: 00000100:00100000:1.0:1785389875.470561:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389875.471519:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879196672 00000100:00100000:2.0:1785389875.471549:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879196672 00000100:00100000:1.0:1785389875.473630:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000001edd0f23 going to sleep for 11 seconds 00000100:00100000:3.0:1785389875.474606:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785389875.474625:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006162d05b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+6:5784:x1872116879196672:12345-0@lo:501: 00000100:00100000:2.0:1785389875.485704:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006162d05b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+6:5784:x1872116879196672:12345-0@lo:501: Request processed in 11081us (15135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785389875.485719:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785389875.485880:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000000bfd61a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196672:0@lo:501: 10000000:01000000:0.0:1785389875.485921:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1785389875.485943:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.485954:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000494d99c2/0x33dffe75ff5ec970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389875.485964:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf509225000 10000000:01000000:0.0:1785389875.485970:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785389875.485974:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cf509225000 10000000:01000000:0.0:1785389875.485977:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1785389875.485980:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8cf509225000 from 1 10000000:01000000:0.0:1785389875.485982:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1785389875.486016:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.486024:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.486034:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389875.486051:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ffbb710c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196800:0@lo:101: 00000100:00100000:0.0:1785389875.486085:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389875.486146:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000005d3070b1 going to sleep for 11 seconds 00000100:00100000:2.0:1785389875.486875:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879196800 00000100:00100000:2.0:1785389875.486882:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879196800 00000100:00100000:2.0:1785389875.486926:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785389875.486935:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c078fa85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+6:5784:x1872116879196800:12345-0@lo:101: 00010000:00010000:2.0:1785389875.486949:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389875.486963:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ec97e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.486999:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ec97e expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.487008:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000105fdfb8/0x33dffe75ff5ec985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec97e expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389875.487015:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000105fdfb8, rc 0) 00000100:00100000:2.0:1785389875.487057:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c078fa85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+7:5784:x1872116879196800:12345-0@lo:101: Request processed in 125us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389875.487063:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785389875.487146:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ffbb710c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196800:0@lo:101: 00010000:00010000:0.0:1785389875.487158:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.487165:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389875.487191:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1785389875.487207:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.487213:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 0000000001a8960e/0x33dffe75ff5ec97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389875.487218:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1785389875.487222:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785389875.487226:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cf509225000 10000000:01000000:0.0:1785389875.487229:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1785389875.487232:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1785389875.487234:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1785389875.487249:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.487256:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389875.487261:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389875.487272:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ffbb710c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196928:0@lo:101: 00000100:00100000:0.0:1785389875.487295:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389875.487323:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000005d3070b1 going to sleep for 11 seconds 00000100:00100000:3.0:1785389875.487468:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879196928 00000100:00100000:3.0:1785389875.487472:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879196928 00000100:00100000:3.0:1785389875.487506:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785389875.487513:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d2fd7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+7:5784:x1872116879196928:12345-0@lo:101: 00010000:00010000:3.0:1785389875.487521:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389875.487553:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021d1b9f1/0x33dffe75ff5ec993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ec98c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.487568:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021d1b9f1/0x33dffe75ff5ec993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.487576:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021d1b9f1/0x33dffe75ff5ec993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.487583:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021d1b9f1, rc 0) 00000100:00100000:3.0:1785389875.487614:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d2fd7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+8:5784:x1872116879196928:12345-0@lo:101: Request processed in 102us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389875.487619:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785389875.487659:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ffbb710c pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879196928:0@lo:101: 00010000:00010000:3.0:1785389875.487668:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389875.487674:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389875.487732:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f897ce9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197056:0@lo:501: 00000100:00100000:3.0:1785389875.487758:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389875.487771:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000002790013e going to sleep for 11 seconds 00000100:00100000:3.0:1785389875.487855:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197056 00000100:00100000:3.0:1785389875.487860:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197056 00000100:00100000:3.0:1785389875.487879:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785389875.487884:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000123ebba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+8:5784:x1872116879197056:12345-0@lo:501: 00000100:00100000:3.0:1785389875.488124:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000123ebba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5784:x1872116879197056:12345-0@lo:501: Request processed in 227us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389875.488132:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785389875.488164:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f897ce9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197056:0@lo:501: 00000100:00100000:3.0:1785389875.488190:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f897ce9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197184:0@lo:503: 00000100:00100000:3.0:1785389875.488228:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389875.488241:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000002790013e going to sleep for 11 seconds 00000100:00100000:3.0:1785389875.488253:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197184 00000100:00100000:3.0:1785389875.488256:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197184 00000100:00100000:3.0:1785389875.488272:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785389875.488277:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c3ce5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5784:x1872116879197184:12345-0@lo:503: 00000100:00100000:3.0:1785389875.488924:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c3ce5aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5784:x1872116879197184:12345-0@lo:503: Request processed in 645us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389875.488940:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785389875.489082:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f897ce9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197184:0@lo:503: 00000100:00100000:2.0:1785389875.490268:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000270354ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5825:1872116879197312:0@lo:502: 00000100:00100000:2.0:1785389875.490322:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389875.490360:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000002cbf5b41 going to sleep for 11 seconds 00000100:00100000:0.0:1785389875.490496:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197312 00000100:00100000:0.0:1785389875.490502:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197312 00000100:00100000:0.0:1785389875.490567:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785389875.490576:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5431e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5825:x1872116879197312:12345-0@lo:502: 00000100:00100000:0.0:1785389875.490742:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5431e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5825:x1872116879197312:12345-0@lo:502: Request processed in 168us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389875.490749:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785389875.490900:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000270354ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5825:1872116879197312:0@lo:502: 00000020:01000000:2.0:1785389875.490919:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389875.490929:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389875.490931:0:5825:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785389875.490936:0:5825:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1785389875.490939:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785389875.490956:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bd7e6160) 00000020:00000080:2.0:1785389875.490971:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1785389875.490975:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1785389875.491038:0:5825:0:(osd_handler.c:1572:osd_obd_connect()) connect #2 00000020:00000080:2.0:1785389875.491044:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ec9a1 00000020:00000080:2.0:1785389875.491263:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1785389875.491267:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389875.491273:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389875.491275:0:5825:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785389875.491277:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389875.491280:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389875.491282:0:5825:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1785389875.491284:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785389875.491290:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005d7f1698) 00000020:00000080:2.0:1785389875.491298:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1785389875.491301:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1785389875.491313:0:5825:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1785389875.491315:0:5825:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1785389875.491321:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785389875.491514:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000066afedaa from lustre-MDT0000, refs=3 00000020:00000080:2.0:1785389875.491680:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bccbd274) 00000020:00000080:2.0:1785389875.491690:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1785389875.491742:0:5825:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1785389875.491747:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5ec9b6 00000020:00000080:2.0:1785389875.492728:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1785389875.492736:0:5825:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1785389875.492742:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x33dffe75ff5ec9bd 00080000:01000000:2.0:1785389875.492747:0:5825:0:(osd_handler.c:1572:osd_obd_connect()) connect #3 00000020:00000080:2.0:1785389875.492750:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ec9c4 00080000:10000000:2.0:1785389875.493287:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1785389875.494753:0:5825:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1785389875.508629:0:5825:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1785389875.606400:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389875.618568:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1785389875.619031:0:5825:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1785389875.624105:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1785389875.625730:0:5825:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1785389875.692094:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fd9d429a) 00000020:00000080:0.0:1785389875.692132:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1785389875.692226:0:5825:0:(osd_handler.c:1572:osd_obd_connect()) connect #4 00000020:00000080:0.0:1785389875.692234:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ec9d2 00000020:00000080:2.0:1785389875.702560:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1785389875.711419:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389875.841477:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389875.941932:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1785389876.127488:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1785389876.217614:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1785389876.359644:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1785389876.424922:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x33dffe75ff5ec9d9 00000020:00000080:3.0:1785389876.435557:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1785389876.435571:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389876.436888:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389876.436893:0:5825:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1785389876.436900:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389876.436905:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389876.436907:0:5825:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1785389876.436910:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1785389876.436924:0:5825:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1785389876.436927:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389876.436930:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389876.436931:0:5825:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1785389876.436933:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389876.436937:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389876.436938:0:5825:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1785389876.436941:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1785389876.436993:0:5825:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1785389876.437048:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000270354ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5825:1872116879197440:0@lo:502: 00000100:00100000:2.0:1785389876.437136:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389876.437242:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000196d7bef going to sleep for 11 seconds 00000100:00100000:2.0:1785389876.443494:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197440 00000100:00100000:2.0:1785389876.443509:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197440 00000100:00100000:2.0:1785389876.443582:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785389876.443591:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014a8b164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5825:x1872116879197440:12345-0@lo:502: 00000100:00100000:2.0:1785389876.450992:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014a8b164 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5825:x1872116879197440:12345-0@lo:502: Request processed in 7396us (13849us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389876.451007:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785389876.451192:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000270354ac pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5825:1872116879197440:0@lo:502: 00000020:01000000:3.0:1785389876.451239:0:5825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389876.451247:0:5825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389876.451250:0:5825:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1785389876.451254:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1785389876.452284:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1785389876.452312:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1785389876.452459:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.452471:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000078b3c24/0x33dffe75ff5ec98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389876.452478:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf509225000 from 1 10000000:01000000:2.0:1785389876.452480:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785389876.452514:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.452620:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.452630:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389876.452648:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfe7a046 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197568:0@lo:101: 00000100:00100000:2.0:1785389876.452689:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389876.452787:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197568 00000100:00100000:3.0:1785389876.452793:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197568 00000100:00100000:3.0:1785389876.452825:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785389876.452832:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d45ae1da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:5784:x1872116879197568:12345-0@lo:101: 00010000:00010000:3.0:1785389876.452845:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389876.452857:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ec9e0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.452876:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.452885:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.452893:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cce42489, rc 0) 00000100:00100000:3.0:1785389876.452920:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d45ae1da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:5784:x1872116879197568:12345-0@lo:101: Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389876.452926:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785389876.453853:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ffe95d73 going to sleep for 11 seconds 00000100:00100000:2.0:1785389876.453872:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfe7a046 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197568:0@lo:101: 00010000:00010000:2.0:1785389876.453883:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.453892:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389876.454514:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfe7a046 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197696:0@lo:256: 00000100:00100000:2.0:1785389876.454578:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389876.454600:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ffe95d73 going to sleep for 11 seconds 00000100:00100000:3.0:1785389876.454749:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197696 00000100:00100000:3.0:1785389876.454755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197696 00000100:00100000:3.0:1785389876.454793:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785389876.454800:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb1a80d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:5784:x1872116879197696:12345-0@lo:256: 20000000:01000000:3.0:1785389876.454815:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1785389876.454820:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1785389876.454901:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb1a80d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:5784:x1872116879197696:12345-0@lo:256: Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389876.454908:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785389876.454932:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfe7a046 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197696:0@lo:256: 10000000:01000000:3.0:1785389876.456045:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785389876.456058:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.456068:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389876.456076:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf509225000 from 1 10000000:01000000:3.0:1785389876.456079:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785389876.456102:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.456120:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.456128:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389876.456141:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000919a466f pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197824:0@lo:101: 00000100:00100000:3.0:1785389876.456180:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389876.456260:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197824 00000100:00100000:2.0:1785389876.456265:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197824 00000100:00100000:2.0:1785389876.456289:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1785389876.456294:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e133bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:5784:x1872116879197824:12345-0@lo:101: 00010000:00010000:2.0:1785389876.457867:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389876.457883:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ec9ee expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.457918:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.457928:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389876.457936:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3168d00, rc 0) 00000100:00100000:2.0:1785389876.457973:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e133bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879197824:12345-0@lo:101: Request processed in 1679us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389876.457979:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785389876.461889:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2b6ab11 going to sleep for 11 seconds 00000100:00100000:3.0:1785389876.461929:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000919a466f pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197824:0@lo:101: 00010000:00010000:3.0:1785389876.461949:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.461961:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389876.462029:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000919a466f pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197952:0@lo:501: 00000100:00100000:3.0:1785389876.462080:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389876.462116:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2b6ab11 going to sleep for 11 seconds 00000100:00100000:1.0:1785389876.463414:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879197952 00000100:00100000:1.0:1785389876.463421:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879197952 00000100:00100000:1.0:1785389876.463466:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785389876.463474:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000946f91aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879197952:12345-0@lo:501: 00000100:00100000:1.0:1785389876.463993:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000946f91aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879197952:12345-0@lo:501: Request processed in 519us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389876.464000:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785389876.464038:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000919a466f pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879197952:0@lo:501: 00000100:00100000:1.0:1785389876.464069:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a70d033b pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198080:0@lo:503: 00000100:00100000:1.0:1785389876.464117:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389876.464140:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198080 00000100:00100000:1.0:1785389876.464144:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198080 00000100:00100000:1.0:1785389876.464160:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785389876.464165:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fa9402c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879198080:12345-0@lo:503: 00000040:00080000:1.0:1785389876.464196:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785389876.464229:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fa9402c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879198080:12345-0@lo:503: Request processed in 64us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389876.464236:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785389876.464268:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012ff1557 going to sleep for 11 seconds 00000100:00100000:1.0:1785389876.464279:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a70d033b pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198080:0@lo:503: 00000040:00080000:1.0:1785389876.466002:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1785389876.466159:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1785389876.466178:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785389876.466201:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.466219:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389876.466263:0:5784:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785389876.466266:0:5784:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf509225000 10000000:01000000:3.0:1785389876.466269:0:5784:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf509225000 10000000:01000000:3.0:1785389876.466273:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785389876.466279:0:5784:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf509225000 from 1 10000000:01000000:3.0:1785389876.466281:0:5784:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785389876.466320:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.466484:0:5784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.466493:0:5784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389876.466513:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198208:0@lo:101: 00000100:00100000:3.0:1785389876.466611:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389876.466640:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000005b4e3524 going to sleep for 11 seconds 00000100:00100000:1.0:1785389876.466764:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198208 00000100:00100000:1.0:1785389876.466771:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198208 00000100:00100000:1.0:1785389876.466817:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785389876.466824:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000054707a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879198208:12345-0@lo:101: 00010000:00010000:1.0:1785389876.466835:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785389876.466847:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000550319b0/0x33dffe75ff5eca03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ec9fc expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.466865:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000550319b0/0x33dffe75ff5eca03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.466874:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000550319b0/0x33dffe75ff5eca03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.466882:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000550319b0, rc 0) 00000100:00100000:1.0:1785389876.466914:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000054707a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5784:x1872116879198208:12345-0@lo:101: Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389876.466920:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785389876.467041:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198208:0@lo:101: 00010000:00010000:3.0:1785389876.467052:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389876.467060:0:5784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389876.467101:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198336:0@lo:501: 00000100:00100000:3.0:1785389876.467139:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389876.467159:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000005b4e3524 going to sleep for 11 seconds 00000100:00100000:3.0:1785389876.467173:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198336 00000100:00100000:3.0:1785389876.467177:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198336 00000100:00100000:3.0:1785389876.467197:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785389876.467202:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d563441f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5784:x1872116879198336:12345-0@lo:501: 00000100:00100000:3.0:1785389876.467593:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d563441f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5784:x1872116879198336:12345-0@lo:501: Request processed in 391us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389876.467600:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785389876.467639:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198336:0@lo:501: 00000100:00100000:3.0:1785389876.467663:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198464:0@lo:503: 00000100:00100000:3.0:1785389876.467697:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389876.467715:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 000000005b4e3524 going to sleep for 11 seconds 00000100:00100000:3.0:1785389876.467726:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198464 00000100:00100000:3.0:1785389876.467730:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198464 00000100:00100000:3.0:1785389876.467745:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785389876.467749:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4fb6a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5784:x1872116879198464:12345-0@lo:503: 00000100:00100000:3.0:1785389876.468676:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4fb6a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5784:x1872116879198464:12345-0@lo:503: Request processed in 923us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389876.468685:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785389876.468731:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198464:0@lo:503: 00000100:00100000:2.0:1785389876.482946:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c12b08ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5830:1872116879198592:0@lo:502: 00000100:00100000:2.0:1785389876.483045:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389876.483148:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e601c451 going to sleep for 11 seconds 00000100:00100000:3.0:1785389876.485961:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198592 00000100:00100000:3.0:1785389876.485975:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198592 00000100:00100000:2.0:1785389876.490087:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785389876.490099:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006155bd5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5830:x1872116879198592:12345-0@lo:502: 00000100:00100000:2.0:1785389876.490624:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006155bd5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5830:x1872116879198592:12345-0@lo:502: Request processed in 527us (7579us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389876.490631:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785389876.490756:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c12b08ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5830:1872116879198592:0@lo:502: 00000020:01000004:3.0:1785389876.490834:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1785389876.490849:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000211060a0) 00000020:00000080:3.0:1785389876.490867:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1785389876.491015:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000066afedaa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785389876.491019:0:5830:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000066afedaa from lustre-MDT0000, refs=4 00000020:01000004:3.0:1785389876.491021:0:5830:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000066afedaa 4 00010000:00080000:3.0:1785389876.491046:0:5830:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000078880905@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1785389876.494605:0:5830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1785389876.494708:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1785389876.494741:0:5830:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785389876.494753:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x33dffe75ff5eca11 00000100:00080000:3.0:1785389876.494761:0:5830:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785389876.496866:0:5830:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000078880905 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785389876.496918:0:5830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000017ff0e7a x1872116879198720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785389876.496955:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1785389876.497226:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879198720:0@lo:38: 00000100:00100000:1.0:1785389876.499310:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389876.499614:0:5830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd65fcb pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5830:1872116879198848:0@lo:502: 00000100:00100000:1.0:1785389876.499670:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389876.499705:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198848 00000100:00100000:1.0:1785389876.499711:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198848 00000100:00100000:1.0:1785389876.499748:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785389876.499755:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030aeedd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5830:x1872116879198848:12345-0@lo:502: 00000100:00100000:1.0:1785389876.499974:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030aeedd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5830:x1872116879198848:12345-0@lo:502: Request processed in 218us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389876.499981:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785389876.500062:0:5830:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003fa6dcd going to sleep for 11 seconds 00000100:00100000:1.0:1785389876.500082:0:5830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd65fcb pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:5830:1872116879198848:0@lo:502: 00000040:00080000:1.0:1785389876.500122:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1785389876.500187:0:5784:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1785389876.500206:0:5784:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785389876.500230:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.500240:0:5784:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 000000009e9b6abf/0x33dffe75ff5ec9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1785389876.500279:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1785389876.500281:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785389876.500283:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389876.500284:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389876.500285:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389876.500286:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389876.500287:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785389876.500289:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785389876.500290:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389876.500291:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389876.500292:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389876.500293:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785389876.500296:0:5784:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1785389876.500299:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785389876.500304:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785389876.500305:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389876.500306:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389876.500307:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389876.500308:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389876.500309:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785389876.500309:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785389876.500310:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389876.500311:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389876.500311:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389876.500312:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785389876.500335:0:5784:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1785389876.500343:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd65fcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198976:0@lo:253: 00000100:00100000:1.0:1785389876.500369:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389876.500380:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003fa6dcd going to sleep for 11 seconds 00000100:00100000:1.0:1785389876.500400:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198976 00000100:00100000:1.0:1785389876.500403:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198976 00000100:00100000:1.0:1785389876.500422:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785389876.500427:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b1b3347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5784:x1872116879198976:12345-0@lo:253: 20000000:01000000:1.0:1785389876.500443:0:5795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1785389876.500455:0:5795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1785389876.503348:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879198720 00000100:00100000:3.0:1785389876.503360:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879198720 00000100:00100000:3.0:1785389876.503395:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785389876.503401:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a70d033b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872116879198720:12345-0@lo:38: 00000100:00100000:3.0:1785389876.503481:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a70d033b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872116879198720:12345-0@lo:38: Request processed in 78us (6184us total) trans 0 rc -11/-11 00000100:00100000:3.0:1785389876.503487:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785389876.507891:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785389876.507905:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000078880905 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1785389876.507913:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1785389876.507917:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000017ff0e7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879198720:0@lo:38: 20000000:01000000:1.0:1785389876.571192:0:5795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1785389876.571206:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1785389876.571235:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785389876.571240:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785389876.571258:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.571276:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.571295:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.571434:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389876.571448:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 12 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389876.571462:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000144dd11 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1872116879199104:0@lo:104: 00000100:00100000:1.0:1785389876.571520:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389876.571580:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 000000007ecc1f26 going to sleep for 11 seconds 00000100:00100000:0.0:1785389876.571674:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199104 00000100:00100000:0.0:1785389876.571681:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199104 00000100:00100000:0.0:1785389876.571725:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389876.571731:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093dbb5eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5818:x1872116879199104:12345-0@lo:104: 00010000:00010000:0.0:1785389876.571742:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571800:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785389876.571805:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093dbb5eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5818:x1872116879199104:12345-0@lo:104: Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389876.571811:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389876.571842:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000144dd11 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1872116879199104:0@lo:104: 00010000:00010000:0.0:1785389876.571858:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571871:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785389876.571875:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571882:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afa35a29 already unused, calling callback (00000000e9504f56) 10000000:00010000:0.0:1785389876.571891:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571898:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785389876.571904:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389876.571909:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1785389876.571930:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571936:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785389876.571947:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571953:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: 00000000afa35a29/0x33dffe75ff5ec9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec9e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.571967:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389876.571968:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389876.571969:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389876.572280:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000609537de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879199232:0@lo:103: 00000100:00100000:3.0:1785389876.572308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389876.572718:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199232 00000100:00100000:0.0:1785389876.572723:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199232 00010000:00010000:0.0:1785389876.572738:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389876.572760:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389876.572765:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088fb0cb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3308:x1872116879199232:12345-0@lo:103: 00010000:00010000:0.0:1785389876.572775:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785389876.572786:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572796:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572808:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cce42489/0x33dffe75ff5ec9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ec9e0 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572821:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572828:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785389876.572839:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001600032s 00010000:00010000:0.0:1785389876.572842:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572848:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572854:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572859:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572864:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000354d1a6b already unused, calling callback (0000000088e6a38f) 00010000:00010000:0.0:1785389876.572867:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572873:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572888:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572897:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785389876.572923:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088fb0cb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3308:x1872116879199232:12345-0@lo:103: Request processed in 158us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389876.572930:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1785389876.572948:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572954:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389876.572960:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000354d1a6b/0x33dffe75ff5eca18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389876.572984:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000609537de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879199232:0@lo:103: 00010000:00010000:1.0:1785389876.640632:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389876.658574:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b1b3347 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5784:x1872116879198976:12345-0@lo:253: Request processed in 158138us (158196us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389876.658593:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785389876.662247:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd65fcb pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:5784:1872116879198976:0@lo:253: 10000000:01000000:1.0:1785389876.662268:0:5784:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785389876.662271:0:5784:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785389876.662274:0:5784:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785389876.662275:0:5784:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389876.662276:0:5784:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389876.662277:0:5784:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389876.662279:0:5784:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389876.662280:0:5784:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785389876.662281:0:5784:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785389876.662283:0:5784:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389876.662284:0:5784:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389876.662285:0:5784:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389876.662286:0:5784:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785389876.662479:0:5784:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1785389876.670839:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389876.671224:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1785389876.671624:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389876.671786:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1785389876.671956:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389876.672118:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1785389876.674925:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389876.676484:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1785389876.676747:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389876.676939:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1785389876.677153:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1785389876.678275:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1785389876.763419:0:5784:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1785389876.836712:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1785389876.836977:0:5836:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1785389876.837156:0:5835:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1785389876.837161:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1785389876.839983:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1785389876.841631:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1785389876.845988:0:5784:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1785389876.846013:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1785389876.851722:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785389876.854756:0:5784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1785389876.858827:0:5784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1785389876.858889:0:5784:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1785389876.859486:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1785389876.875131:0:5784:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1785389876.881538:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1785389876.881682:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1785389876.881797:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1785389876.881926:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1785389876.882054:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1785389876.882213:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1785389876.889959:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1785389876.890149:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1785389876.890368:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1785389876.890514:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1785389876.890665:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1785389876.890785:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1785389876.890905:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1785389876.891023:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1785389876.891201:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1785389876.895190:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1785389876.898578:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1785389876.898716:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1785389876.898875:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1785389876.899025:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1785389876.899223:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1785389876.899373:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1785389876.903547:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1785389876.903731:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1785389876.903864:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1785389876.903981:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1785389876.904166:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1785389876.906596:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1785389876.906778:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1785389876.906931:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1785389876.907080:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1785389876.907248:0:5784:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1785389876.907464:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1785389876.932163:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1785389877.042978:0:5784:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1785389877.043021:0:5784:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac6641803988 00100000:10000000:1.0:1785389877.043028:0:5784:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1785389877.065500:0:5784:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785389877.065516:0:5784:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785389877.065543:0:5784:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1785389877.065570:0:5784:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1785389877.087061:0:5836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1785389877.087147:0:5836:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1785389877.087151:0:5836:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1785389877.656064:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389878.686348:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389879.710257:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389880.727678:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389881.752499:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785389881.885260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1785389881.885270:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1785389881.885273:0:8:0:(import.c:65:import_set_state_nolock()) 0000000078880905 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785389881.885297:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000078880905 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1785389881.885316:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a34431b x1872116879199488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785389881.885359:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a34431b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879199488:0@lo:38: 00000100:00100000:2.0:1785389881.885420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389881.885625:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199488 00000100:00100000:1.0:1785389881.885633:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199488 00000100:00100000:1.0:1785389881.885663:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785389881.885669:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b1f4a13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872116879199488:12345-0@lo:38: 00010000:00080000:1.0:1785389881.885694:0:5804:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1785389881.885727:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x33dffe75ff5eca1f 00000004:00100000:1.0:1785389881.885771:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1785389881.885868:0:5804:0:(import.c:65:import_set_state_nolock()) 00000000ccabfe5f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785389881.885914:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b1f4a13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872116879199488:12345-0@lo:38: Request processed in 244us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389881.885921:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785389881.886099:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a34431b x1872116879199488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785389891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785389881.886114:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1785389881.886120:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1785389881.886124:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785389881.886126:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000078880905 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785389881.886131:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a34431b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879199488:0@lo:38: 00000100:00100000:0.0:1785389881.886308:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a80fcde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879199360:0@lo:400: 00000100:00100000:0.0:1785389881.886350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389881.886456:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199360 00000100:00100000:1.0:1785389881.886461:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199360 00000100:00100000:1.0:1785389881.886495:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785389881.886500:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ee7ce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3309:x1872116879199360:12345-0@lo:400: 00000100:00100000:1.0:1785389881.886698:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ee7ce5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3309:x1872116879199360:12345-0@lo:400: Request processed in 197us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389881.886704:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1785389881.886812:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a80fcde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879199360:0@lo:400: 00010000:00010000:2.0:1785389882.781409:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785389883.658215:0:6079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785389883.799142:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1785389883.927601:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1785389883.927608:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf509225000 from 3 10000000:01000000:1.0:1785389883.927612:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785389883.927655:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389883.927684:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389883.927695:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389883.927717:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000edd65fcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879199616:0@lo:101: 00000100:00100000:1.0:1785389883.927779:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389883.927822:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f819439a going to sleep for 11 seconds 00000100:00100000:2.0:1785389883.928195:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199616 00000100:00100000:2.0:1785389883.928203:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199616 00000100:00100000:2.0:1785389883.928252:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785389883.928260:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000913c52a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5800:x1872116879199616:12345-0@lo:101: 00010000:00010000:2.0:1785389883.928274:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389883.928286:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000014af558b/0x33dffe75ff5eca2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eca26 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389883.928307:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014af558b/0x33dffe75ff5eca2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389883.928316:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000014af558b/0x33dffe75ff5eca2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389883.928335:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000014af558b, rc 0) 00000100:00100000:2.0:1785389883.930571:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000913c52a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879199616:12345-0@lo:101: Request processed in 2307us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389883.930581:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1785389883.933540:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000edd65fcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879199616:0@lo:101: 00010000:00010000:0.0:1785389883.933567:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389883.933579:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389883.933652:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000609537de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879199744:0@lo:256: 00000100:00100000:0.0:1785389883.933706:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389883.933742:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afdf80bf going to sleep for 11 seconds 00000100:00100000:2.0:1785389883.933943:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199744 00000100:00100000:2.0:1785389883.933949:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199744 00000100:00100000:2.0:1785389883.933993:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785389883.933999:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ed9ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879199744:12345-0@lo:256: 20000000:01000000:2.0:1785389883.934018:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785389883.934031:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785389883.934033:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1785389883.934138:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ed9ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879199744:12345-0@lo:256: Request processed in 139us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389883.934146:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1785389883.934194:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000609537de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879199744:0@lo:256: 10000000:01000000:0.0:1785389883.934243:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1785389883.934249:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389883.934256:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: 0000000042599083/0x33dffe75ff5eca26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389884.821654:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389885.847617:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389886.869686:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389886.998180:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785389886.998189:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000609537de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879199872:0@lo:400: 00000100:00100000:0.0:1785389886.998202:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879200000:0@lo:400: 00000100:00100000:2.0:1785389886.998272:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389886.998279:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389886.998338:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879199872 00000100:00100000:2.0:1785389886.998346:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879199872 00000100:00100000:2.0:1785389886.998407:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785389886.998416:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018219767 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3310:x1872116879199872:12345-0@lo:400: 00000100:00100000:1.0:1785389886.998439:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200000 00000100:00100000:1.0:1785389886.998445:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200000 00000100:00100000:2.0:1785389886.998477:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018219767 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3310:x1872116879199872:12345-0@lo:400: Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389886.998484:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785389886.998488:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785389886.998496:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8d33a5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879200000:12345-0@lo:400: 00000100:00100000:2.0:1785389886.998551:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000609537de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879199872:0@lo:400: 00000100:00100000:1.0:1785389886.998570:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8d33a5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879200000:12345-0@lo:400: Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389886.998578:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1785389887.000052:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d2542d51 x1872116879200000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389887.000082:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879200000:0@lo:400: 00010000:00010000:3.0:1785389887.904471:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389888.923025:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389889.947753:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1785389890.454381:0:6281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2190b860 20000000:00000080:2.0:1785389890.454398:0:6281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf53af9c800 uarg=0000000000000000 20000000:01000000:2.0:1785389890.454428:0:6281:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1785389890.454433:0:6281:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1785389890.454438:0:6281:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1785389890.454660:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1785389890.454672:0:6281:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1785389890.470020:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785389890.470250:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1785389890.470315:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1785389890.470367:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1785389890.470386:0:6281:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1785389890.470401:0:6281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389890.470418:0:6281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389890.470426:0:6281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389890.470467:0:6281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389890.470482:0:6281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 11 pid: 5797 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389890.470495:0:6281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fa7bfc63 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1872116879200128:0@lo:104: 00000100:00100000:3.0:1785389890.470582:0:6281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389890.470639:0:6281:0:(client.c:2702:ptlrpc_set_wait()) set 000000006b3f2392 going to sleep for 11 seconds 00000100:00100000:1.0:1785389890.470652:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200128 00000100:00100000:1.0:1785389890.470660:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200128 00000100:00100000:1.0:1785389890.470704:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785389890.470712:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058dfe0c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:6281:x1872116879200128:12345-0@lo:104: 00010000:00010000:1.0:1785389890.470723:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389890.470789:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785389890.470794:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058dfe0c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:6281:x1872116879200128:12345-0@lo:104: Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389890.470811:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785389890.470829:0:6281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fa7bfc63 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1872116879200128:0@lo:104: 00010000:00010000:3.0:1785389890.470846:0:6281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.470872:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785389890.470877:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.470883:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047aeb9df already unused, calling callback (00000000e9504f56) 10000000:00010000:0.0:1785389890.470886:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.470892:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785389890.470898:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389890.470903:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1785389890.470934:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.470940:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785389890.470964:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.470970:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: 0000000047aeb9df/0x33dffe75ff5ec9ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec9f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.470995:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389890.470997:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389890.471004:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389890.471011:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785389890.471020:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879200256:0@lo:103: 00000100:00100000:0.0:1785389890.471047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389890.471074:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200256 00000100:00100000:0.0:1785389890.471078:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200256 00010000:00010000:0.0:1785389890.471106:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 12 pid: 5797 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389890.471126:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785389890.471132:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baad20fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3307:x1872116879200256:12345-0@lo:103: 00010000:00010000:0.0:1785389890.471140:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785389890.471144:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 12 pid: 5797 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471152:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 12 pid: 5797 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471163:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3168d00/0x33dffe75ff5ec9f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ec9ee expref: 12 pid: 5797 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471174:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471180:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471190:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471196:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471207:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471212:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471217:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000adaa10bd already unused, calling callback (0000000088e6a38f) 00010000:00010000:0.0:1785389890.471220:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471226:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471235:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.471243:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785389890.471266:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baad20fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3307:x1872116879200256:12345-0@lo:103: Request processed in 136us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389890.471272:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785389890.471308:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879200256:0@lo:103: 00010000:00010000:3.0:1785389890.471832:0:6281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389890.471840:0:6281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389890.471845:0:6281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000adaa10bd/0x33dffe75ff5eca34 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389890.965723:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389891.989826:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389892.127231:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da4bb8cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879200512:0@lo:400: 00000100:00100000:3.0:1785389892.127313:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389892.127362:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785389892.127367:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fa7bfc63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879200384:0@lo:400: 00000100:00100000:3.0:1785389892.127391:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389892.127427:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200384 00000100:00100000:3.0:1785389892.127439:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200384 00000100:00100000:3.0:1785389892.127475:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785389892.127481:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001252efbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3310:x1872116879200384:12345-0@lo:400: 00000100:00100000:3.0:1785389892.127541:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001252efbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3310:x1872116879200384:12345-0@lo:400: Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389892.127548:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785389892.127576:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200512 00000100:00100000:3.0:1785389892.127579:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200512 00000100:00100000:3.0:1785389892.127600:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785389892.127605:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cc9615a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879200512:12345-0@lo:400: 00000100:00100000:3.0:1785389892.127846:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cc9615a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879200512:12345-0@lo:400: Request processed in 241us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389892.127853:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785389892.127882:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fa7bfc63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879200384:0@lo:400: 00010000:00080000:3.0:1785389892.127894:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000da4bb8cf x1872116879200512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389892.127904:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da4bb8cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879200512:0@lo:400: 10000000:01000000:0.0:1785389892.444392:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785389892.444399:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf509225000 from 1 10000000:01000000:0.0:1785389892.444404:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785389892.444461:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: 0000000038ef212b/0x33dffe75ff5eca3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389892.444474:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: 0000000038ef212b/0x33dffe75ff5eca3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389892.444498:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: 0000000038ef212b/0x33dffe75ff5eca3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389892.444519:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879200640:0@lo:101: 00000100:00100000:0.0:1785389892.444601:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389892.444708:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075cf5dd7 going to sleep for 11 seconds 00000100:00100000:3.0:1785389892.444761:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200640 00000100:00100000:3.0:1785389892.444768:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200640 00000100:00100000:3.0:1785389892.444819:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785389892.444827:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056a37d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:5800:x1872116879200640:12345-0@lo:101: 00010000:00010000:3.0:1785389892.444840:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389892.444852:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000482dbfb8/0x33dffe75ff5eca42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eca3b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389892.444871:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000482dbfb8/0x33dffe75ff5eca42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389892.444891:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000482dbfb8/0x33dffe75ff5eca42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389892.444899:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000482dbfb8, rc 0) 00000100:00100000:3.0:1785389892.444934:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056a37d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879200640:12345-0@lo:101: Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389892.444940:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785389892.445036:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879200640:0@lo:101: 00010000:00010000:0.0:1785389892.445048:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: 0000000038ef212b/0x33dffe75ff5eca3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389892.445055:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: 0000000038ef212b/0x33dffe75ff5eca3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389892.445163:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879200768:0@lo:501: 00000100:00100000:0.0:1785389892.445186:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389892.445211:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075cf5dd7 going to sleep for 11 seconds 00000100:00100000:3.0:1785389892.445370:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200768 00000100:00100000:3.0:1785389892.445374:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200768 00000100:00100000:3.0:1785389892.445403:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785389892.445408:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7b87390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879200768:12345-0@lo:501: 00000100:00100000:3.0:1785389892.445652:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7b87390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879200768:12345-0@lo:501: Request processed in 243us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389892.445659:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785389892.445949:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879200768:0@lo:501: 00000100:00100000:0.0:1785389892.445996:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879200896:0@lo:503: 00000100:00100000:0.0:1785389892.446031:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389892.446045:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075cf5dd7 going to sleep for 11 seconds 00000100:00100000:0.0:1785389892.446056:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879200896 00000100:00100000:0.0:1785389892.446060:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879200896 00000100:00100000:0.0:1785389892.447696:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785389892.447706:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc6959b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879200896:12345-0@lo:503: 00000100:00100000:0.0:1785389892.447856:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc6959b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879200896:12345-0@lo:503: Request processed in 152us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389892.447870:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785389892.456270:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d2542d51 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879200896:0@lo:503: 00000100:00100000:3.0:1785389892.457873:0:6341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da4bb8cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6341:1872116879201024:0@lo:502: 00000100:00100000:3.0:1785389892.457950:0:6341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389892.458001:0:6341:0:(client.c:2702:ptlrpc_set_wait()) set 000000006e333f9b going to sleep for 11 seconds 00000100:00100000:0.0:1785389892.458373:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201024 00000100:00100000:0.0:1785389892.458380:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201024 00000100:00100000:0.0:1785389892.458417:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785389892.458423:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3ed506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6341:x1872116879201024:12345-0@lo:502: 00000100:00100000:0.0:1785389892.458841:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3ed506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6341:x1872116879201024:12345-0@lo:502: Request processed in 417us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389892.458849:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1785389892.463251:0:6341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da4bb8cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6341:1872116879201024:0@lo:502: 00000020:01000000:2.0:1785389892.464738:0:6341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389892.464755:0:6341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389892.464757:0:6341:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1785389892.464764:0:6341:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf509225000 00000020:00000080:2.0:1785389892.464767:0:6341:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1785389892.464823:0:6341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6341:1872116879201152:0@lo:502: 00000100:00100000:2.0:1785389892.464893:0:6341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389892.464926:0:6341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389892.466183:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201152 00000100:00100000:3.0:1785389892.466191:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201152 00000100:00100000:3.0:1785389892.466239:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785389892.466247:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6341:x1872116879201152:12345-0@lo:502: 00000100:00100000:3.0:1785389892.466422:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6341:x1872116879201152:12345-0@lo:502: Request processed in 176us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389892.466443:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785389892.467064:0:6341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6341:1872116879201152:0@lo:502: 00000020:01000000:2.0:1785389892.467170:0:6341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389892.467177:0:6341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389892.467179:0:6341:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1785389892.467182:0:6341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1785389892.470261:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1785389892.470344:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785389892.470356:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389892.470370:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389893.014477:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389894.037779:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389895.070792:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389896.085695:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389897.109794:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389897.241416:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879201408:0@lo:400: 00000100:00100000:1.0:1785389897.241487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389897.241561:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785389897.241578:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879201280:0@lo:400: 00000100:00100000:1.0:1785389897.241606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389897.241652:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201408 00000100:00100000:1.0:1785389897.241660:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201408 00000100:00100000:1.0:1785389897.241714:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785389897.241723:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879201408:12345-0@lo:400: 00000100:00100000:1.0:1785389897.241775:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879201408:12345-0@lo:400: Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389897.241781:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785389897.241804:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201280 00000100:00100000:1.0:1785389897.241808:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201280 00000100:00100000:1.0:1785389897.241831:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785389897.241837:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3308:x1872116879201280:12345-0@lo:400: 00000100:00100000:1.0:1785389897.241864:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3308:x1872116879201280:12345-0@lo:400: Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389897.241871:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785389897.241913:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879201280:0@lo:400: 00010000:00080000:1.0:1785389897.241955:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf50de83b80 x1872116879201408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389897.241966:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879201408:0@lo:400: 00000020:01000004:3.0:1785389898.033441:0:6594:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1785389898.033444:0:6594:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1785389898.033822:0:6594:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cf5111bb800 00000020:01000004:3.0:1785389898.033840:0:6594:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1785389898.033852:0:6594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1785389898.033866:0:6594:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cf5058f19c0) 00000020:00000080:3.0:1785389898.033881:0:6594:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1785389898.084059:0:6594:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1785389898.085316:0:6594:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:1.0:1785389898.134769:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1785389898.145209:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1785389898.162054:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785389898.162085:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1785389898.162797:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785389898.162840:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1785389898.165171:0:6594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1785389898.165182:0:6594:0:(osd_handler.c:1572:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785389898.165193:0:6594:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33dffe75ff5eca50 00000020:01000004:3.0:1785389898.165200:0:6594:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1785389898.165218:0:6594:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785389898.165221:0:6594:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785389898.165226:0:6594:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1785389898.165230:0:6594:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1785389898.165251:0:6594:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cf5058f3380) 00000020:00000080:3.0:1785389898.165260:0:6594:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1785389898.170054:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785389898.170202:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1785389898.170207:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1785389898.178321:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1785389898.178337:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1785389898.179690:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1785389898.179699:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1785389898.186361:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785389898.186721:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1785389898.186734:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1785389898.199739:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1785389898.199753:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1785389898.265799:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785389898.266447:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1785389898.266454:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1785389898.280369:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1785389898.280384:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1785389898.284188:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785389898.284202:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1785389898.298669:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785389898.298886:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1785389898.298892:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1785389898.313213:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1785389898.313231:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1785389898.448151:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785389898.448885:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1785389898.448892:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1785389898.450988:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1785389898.450996:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1785389898.451490:0:6594:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1785389898.451514:0:6594:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1785389898.451519:0:6594:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1785389898.534204:0:6594:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1785389898.534239:0:6594:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1785389898.534243:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1785389898.534245:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785389898.534246:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785389898.534248:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785389898.534249:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785389898.534250:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785389898.534252:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785389898.534253:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785389898.534254:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785389898.534256:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785389898.534257:0:6594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785389898.534261:0:6594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1785389898.534263:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785389898.534264:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785389898.534265:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785389898.534266:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785389898.534267:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785389898.534268:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785389898.534269:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785389898.534270:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1785389898.534271:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1785389898.534272:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785389898.534273:0:6594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785389898.534306:0:6594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1785389898.534323:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879201536:0@lo:253: 00000100:00100000:0.0:1785389898.534882:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.534995:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d000 going to sleep for 11 seconds 00000100:00100000:1.0:1785389898.537306:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201536 00000100:00100000:1.0:1785389898.537317:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201536 00000100:00100000:1.0:1785389898.537387:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785389898.537397:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879201536:12345-0@lo:253: 20000000:01000000:1.0:1785389898.537431:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1785389898.537435:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1785389898.537440:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1785389898.537444:0:5798:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1785389898.539947:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785389898.540177:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1785389898.540192:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1785389898.540244:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1785389898.540254:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1785389898.540286:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1785389898.545948:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1785389898.550717:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1785389898.550752:0:5798:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:1.0:1785389898.550755:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:1.0:1785389898.551635:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1785389898.551646:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1785389898.551704:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1785389898.551713:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:1.0:1785389898.551746:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1785389898.552404:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1785389898.552449:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1785389898.552507:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1785389898.570870:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1785389898.570900:0:5798:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:2.0:1785389898.570903:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:2.0:1785389898.570955:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1785389898.570964:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1785389898.570995:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1785389898.571003:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1785389898.571049:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1785389898.571059:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1785389898.571092:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1785389898.571129:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1785389898.571146:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1785389898.571149:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1785389898.571154:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785389898.571156:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785389898.571158:0:5798:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785389898.571171:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785389898.571174:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785389898.571205:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1785389898.571208:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785389898.571949:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1785389898.572192:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1785389898.572234:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1785389898.572306:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1785389898.572320:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1785389898.572322:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785389898.573285:0:6610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1785389898.573331:0:6610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1785389898.573486:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1785389898.573807:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1785389898.573848:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1785389898.573928:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1785389898.573941:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1785389898.573943:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1785389898.577307:0:6611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1785389898.577487:0:6611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1785389898.577621:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1785389898.578644:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1785389898.578691:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1785389898.578728:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1785389898.578749:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1785389898.579402:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.579422:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.579430:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.579438:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.579446:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.579486:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.579499:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 12 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.579513:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1872116879201664:0@lo:104: 00000100:00100000:3.0:1785389898.580448:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785389898.580503:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.580514:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389898.580632:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201664 00000100:00100000:2.0:1785389898.580639:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201664 00000100:00100000:2.0:1785389898.580703:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785389898.580712:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5798:x1872116879201664:12345-0@lo:104: 00010000:00010000:2.0:1785389898.580724:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.580876:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1872116879201792:0@lo:104: 00010000:00010000:2.0:1785389898.580952:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785389898.580959:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5798:x1872116879201664:12345-0@lo:104: Request processed in 248us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.580966:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785389898.581426:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1785389898.581467:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.581476:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 12 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.581486:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1872116879201920:0@lo:104: 00000100:00100000:3.0:1785389898.581507:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.581548:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51104e480 going to sleep for 11 seconds 00000100:00100000:3.0:1785389898.581568:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1872116879201664:0@lo:104: 00000100:00100000:2.0:1785389898.583380:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201792 00000100:00100000:2.0:1785389898.583387:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201792 00000100:00100000:2.0:1785389898.583413:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879201920 00000100:00100000:2.0:1785389898.583415:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879201920 00000100:00100000:2.0:1785389898.583428:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785389898.583435:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:5798:x1872116879201792:12345-0@lo:104: 00010000:00010000:2.0:1785389898.583448:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.583572:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1872116879201792:0@lo:104: 00010000:00010000:0.0:1785389898.592499:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785389898.592513:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.592556:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fcc00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:0.0:1785389898.592576:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.592587:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785389898.592595:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389898.592601:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389898.592751:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.592758:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389898.592792:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.592800:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5013fcc00/0x33dffe75ff5ec9fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca03 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.592816:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785389898.592836:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879202048:0@lo:103: 00000100:00100000:3.0:1785389898.592893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.592952:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202048 00000100:00100000:3.0:1785389898.592965:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202048 00010000:00010000:3.0:1785389898.592992:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 13 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.593023:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785389898.593031:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3310:x1872116879202048:12345-0@lo:103: 00010000:00010000:3.0:1785389898.593057:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389898.593063:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 13 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593074:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 13 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593089:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5eca03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ec9fc expref: 13 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593101:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389898.593133:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3310:x1872116879202048:12345-0@lo:103: Request processed in 103us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.593141:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785389898.593178:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879202048:0@lo:103: 00010000:00010000:3.0:1785389898.593193:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785389898.593197:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593204:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500031000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389898.593207:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593215:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389898.593226:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389898.593231:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389898.593257:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593263:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389898.593272:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593278:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ec98c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec993 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.593292:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879202176:0@lo:103: 00000100:00100000:3.0:1785389898.593312:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.593493:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202176 00000100:00100000:3.0:1785389898.593498:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202176 00010000:00010000:3.0:1785389898.593514:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.593560:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785389898.593567:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3310:x1872116879202176:12345-0@lo:103: 00010000:00010000:3.0:1785389898.593575:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389898.593579:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593587:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593604:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5ec993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ec98c expref: 12 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.593615:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389898.593643:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3310:x1872116879202176:12345-0@lo:103: Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.593649:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785389898.593670:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879202176:0@lo:103: 00010000:00010000:3.0:1785389898.593680:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389898.593682:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389898.593684:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389898.594412:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1785389898.594421:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:5798:x1872116879201792:12345-0@lo:104: Request processed in 10985us (12994us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.594429:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785389898.596364:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785389898.596378:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5798:x1872116879201920:12345-0@lo:104: 00010000:00010000:3.0:1785389898.596392:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.596633:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5798:1872116879201920:0@lo:104: 00010000:00010000:0.0:1785389898.596657:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.597895:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785389898.597902:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.597921:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389898.597924:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.597933:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389898.597940:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389898.597945:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1785389898.598069:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.598076:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785389898.598091:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.598098:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ec970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ec977 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.598111:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389898.598113:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389898.598115:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389898.598846:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879202304:0@lo:103: 00000100:00100000:2.0:1785389898.598890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.598981:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202304 00000100:00100000:0.0:1785389898.598987:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202304 00010000:00010000:0.0:1785389898.599008:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 11 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.599055:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785389898.599062:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:3307:x1872116879202304:12345-0@lo:103: 00010000:00010000:0.0:1785389898.599071:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785389898.599077:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 11 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599087:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 11 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599100:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fce00/0x33dffe75ff5ec977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ec970 expref: 11 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599113:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599121:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599134:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599140:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599147:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599152:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599166:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fc400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785389898.599171:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599179:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599191:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599200:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785389898.599231:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:3307:x1872116879202304:12345-0@lo:103: Request processed in 169us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.599250:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1785389898.599270:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599278:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.599283:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5eca5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785389898.599295:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1785389898.599483:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879202304:0@lo:103: 00010000:00010000:3.0:1785389898.616918:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1785389898.616940:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5798:x1872116879201920:12345-0@lo:104: Request processed in 20559us (35425us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.616952:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1785389898.617407:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389898.762008:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:6594:x1872116879201536:12345-0@lo:253: Request processed in 224604us (227118us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.762023:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785389898.762213:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879201536:0@lo:253: 10000000:01000000:0.0:1785389898.762227:0:6594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1785389898.762229:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785389898.762231:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785389898.762232:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785389898.762294:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1785389898.762296:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785389898.762297:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785389898.762299:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785389898.762300:0:6594:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1785389898.762301:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785389898.762302:0:6594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1785389898.762320:0:6594:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf5111bb800 from lustre-OST0000 10000000:01000000:0.0:1785389898.762342:0:6594:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1785389898.762345:0:6594:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1785389898.762351:0:6594:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf50ddfb380 local copy 10000000:01000000:0.0:1785389898.762355:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1785389898.762388:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.762400:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.762410:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.762428:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202432:0@lo:101: 00000100:00100000:0.0:1785389898.762464:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.762598:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202432 00000100:00100000:1.0:1785389898.762605:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202432 00000100:00100000:1.0:1785389898.762645:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785389898.762654:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:6594:x1872116879202432:12345-0@lo:101: 00010000:00010000:1.0:1785389898.762666:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785389898.762678:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eca6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eca65 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.762705:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eca6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eca65 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.762716:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eca6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca65 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.762725:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785389898.762754:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:6594:x1872116879202432:12345-0@lo:101: Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389898.762759:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785389898.762849:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.762863:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202432:0@lo:101: 00010000:00010000:0.0:1785389898.762874:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.762883:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.762973:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202560:0@lo:501: 00000100:00100000:0.0:1785389898.763003:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.763014:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d840 going to sleep for 11 seconds 00000100:00100000:2.0:1785389898.763093:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202560 00000100:00100000:2.0:1785389898.763152:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202560 00000100:00100000:2.0:1785389898.763182:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785389898.763188:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:6594:x1872116879202560:12345-0@lo:501: 00000100:00100000:2.0:1785389898.763461:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:6594:x1872116879202560:12345-0@lo:501: Request processed in 272us (456us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785389898.763469:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785389898.763620:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202560:0@lo:501: 10000000:01000000:0.0:1785389898.763632:0:6594:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1785389898.763658:0:6594:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1785389898.763663:0:6594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.763672:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.763680:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.763704:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785389898.763720:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf5111bb800 10000000:01000000:0.0:1785389898.763725:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785389898.763729:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cf50ddfb380 10000000:01000000:0.0:1785389898.763731:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1785389898.763735:0:6594:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8cf50ddfb380 from 1 10000000:01000000:0.0:1785389898.763738:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1785389898.763751:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.763759:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.763767:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.763787:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202688:0@lo:101: 00000100:00100000:0.0:1785389898.763809:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.763867:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039de40 going to sleep for 11 seconds 00010000:00010000:2.0:1785389898.763921:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785389898.763927:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.763935:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500031000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785389898.763938:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.763946:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785389898.763953:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389898.763959:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785389898.763975:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.763979:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785389898.764004:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.764011:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5eca65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x33dffe75ff5eca6c expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.764030:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389898.764032:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389898.764034:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389898.764069:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785389898.764079:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879202816:0@lo:103: 00000100:00100000:0.0:1785389898.764113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389898.764215:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202816 00000100:00100000:2.0:1785389898.764220:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202816 00000100:00100000:2.0:1785389898.764258:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785389898.764265:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:3307:x1872116879202816:12345-0@lo:103: 00010000:00010000:2.0:1785389898.764273:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785389898.764283:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eca6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5eca65 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.764294:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785389898.764319:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:3307:x1872116879202816:12345-0@lo:103: Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.764325:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389898.764422:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879202816:0@lo:103: 00000100:00100000:3.0:1785389898.767319:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202688 00000100:00100000:3.0:1785389898.767328:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202688 00000100:00100000:3.0:1785389898.767409:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785389898.767418:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:6594:x1872116879202688:12345-0@lo:101: 00010000:00010000:3.0:1785389898.767430:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389898.767445:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5eca7a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eca73 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.767478:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5eca7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eca73 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.767497:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5eca7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca73 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.767506:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fda00, rc 0) 00000100:00100000:3.0:1785389898.767579:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:6594:x1872116879202688:12345-0@lo:101: Request processed in 162us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.767586:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785389898.767663:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202688:0@lo:101: 00010000:00010000:0.0:1785389898.767678:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.767688:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389898.767705:0:6594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1785389898.767726:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.767733:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389898.767740:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1785389898.767745:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785389898.767749:0:6594:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1785389898.767752:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1785389898.767771:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.767784:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.767794:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.767810:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202944:0@lo:101: 00000100:00100000:0.0:1785389898.767841:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.777027:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039de40 going to sleep for 11 seconds 00000100:00100000:2.0:1785389898.777108:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879202944 00000100:00100000:2.0:1785389898.777118:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879202944 00000100:00100000:2.0:1785389898.777168:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785389898.777177:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+10:6594:x1872116879202944:12345-0@lo:101: 00010000:00010000:2.0:1785389898.777193:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389898.777212:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eca81 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.777378:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.777392:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.777420:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529a00, rc 0) 00000100:00100000:0.0:1785389898.777556:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879202944:12345-0@lo:101: Request processed in 379us (9713us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.777564:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785389898.779264:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879202944:0@lo:101: 00010000:00010000:2.0:1785389898.779285:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.779295:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389898.779413:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203072:0@lo:501: 00000100:00100000:2.0:1785389898.779455:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389898.779480:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf506217f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.779599:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203072 00000100:00100000:0.0:1785389898.779605:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203072 00000100:00100000:0.0:1785389898.779631:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785389898.779639:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203072:12345-0@lo:501: 00000100:00100000:0.0:1785389898.779875:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203072:12345-0@lo:501: Request processed in 235us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.779882:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1785389898.780126:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203072:0@lo:501: 00000100:00100000:2.0:1785389898.780150:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203200:0@lo:503: 00000100:00100000:2.0:1785389898.780184:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389898.780199:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf506217f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.780637:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203200 00000100:00100000:0.0:1785389898.780641:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203200 00000100:00100000:0.0:1785389898.780659:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785389898.780664:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203200:12345-0@lo:503: 00000100:00100000:0.0:1785389898.780811:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203200:12345-0@lo:503: Request processed in 145us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.780818:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1785389898.780896:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203200:0@lo:503: 00000040:00080000:2.0:1785389898.781189:0:6594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785389898.781305:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203328:0@lo:502: 00000100:00100000:2.0:1785389898.781336:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389898.781361:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf506217f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.781405:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203328 00000100:00100000:0.0:1785389898.781409:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203328 00000100:00100000:0.0:1785389898.781425:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1785389898.781430:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203328:12345-0@lo:502: 00000100:00100000:0.0:1785389898.781564:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203328:12345-0@lo:502: Request processed in 133us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.781570:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785389898.781649:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203328:0@lo:502: 00000040:00080000:2.0:1785389898.781913:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1785389898.781957:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1785389898.781986:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1785389898.782039:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1785389898.782069:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1785389898.784179:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1785389898.784394:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203456:0@lo:502: 00000100:00100000:0.0:1785389898.784449:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.784485:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d480 going to sleep for 11 seconds 00000100:00100000:2.0:1785389898.784643:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203456 00000100:00100000:2.0:1785389898.784648:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203456 00000100:00100000:2.0:1785389898.784685:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785389898.784695:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203456:12345-0@lo:502: 00000100:00100000:2.0:1785389898.784860:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203456:12345-0@lo:502: Request processed in 167us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.784868:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785389898.784987:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203456:0@lo:502: 00000040:00080000:0.0:1785389898.785087:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1785389898.785107:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1785389898.785690:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785389898.785697:0:6612:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1785389898.785703:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389898.785705:0:6612:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1785389898.785710:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785389898.785724:0:6612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cf53a898000) 00000020:00000080:2.0:1785389898.785741:0:6612:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1785389898.785745:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785389898.785802:0:6612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf5111bb800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1785389898.785816:0:6612:0:(osd_handler.c:1572:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785389898.785822:0:6612:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33dffe75ff5eca96 00010000:00010000:3.0:1785389898.793973:0:6612:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1785389898.794449:0:6612:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1785389898.800322:0:6612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1785389898.800635:0:6612:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1785389898.821731:0:6612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1785389898.822727:0:6612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1785389898.826870:0:6612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1785389898.826882:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389898.826889:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389898.826891:0:6612:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1785389898.826894:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785389898.826897:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389898.826899:0:6612:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785389898.826901:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785389898.826914:0:6612:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1785389898.826964:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389898.826968:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389898.826969:0:6612:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785389898.826972:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1785389898.827227:0:6594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1785389898.827262:0:6594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1785389898.827276:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.827288:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389898.827295:0:6594:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5111bb800 from 1 10000000:01000000:1.0:1785389898.827298:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785389898.827330:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.827338:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.827349:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389898.827374:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203584:0@lo:101: 00000100:00100000:1.0:1785389898.827435:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.827484:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5356a5900 going to sleep for 11 seconds 00000100:00100000:3.0:1785389898.830198:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203584 00000100:00100000:3.0:1785389898.830210:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203584 00000100:00100000:3.0:1785389898.830260:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785389898.830269:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:6594:x1872116879203584:12345-0@lo:101: 00010000:00010000:3.0:1785389898.830297:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389898.830311:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eca9d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.830338:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.830348:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.830357:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fcc00, rc 0) 00000100:00100000:3.0:1785389898.830420:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203584:12345-0@lo:101: Request processed in 152us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.830427:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785389898.832300:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203584:0@lo:101: 00010000:00010000:0.0:1785389898.832324:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.832343:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389898.832450:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203712:0@lo:501: 00000100:00100000:0.0:1785389898.832487:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.832541:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389898.832742:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203712 00000100:00100000:3.0:1785389898.832747:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203712 00000100:00100000:3.0:1785389898.832795:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1785389898.832804:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203712:12345-0@lo:501: 00000100:00100000:3.0:1785389898.833037:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203712:12345-0@lo:501: Request processed in 233us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.833044:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785389898.833315:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203712:0@lo:501: 00000100:00100000:1.0:1785389898.833348:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203840:0@lo:503: 00000100:00100000:1.0:1785389898.833386:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.833416:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5356a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1785389898.833457:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203840 00000100:00100000:3.0:1785389898.833461:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203840 00000100:00100000:3.0:1785389898.833496:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785389898.833503:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203840:12345-0@lo:503: 00000100:00100000:3.0:1785389898.833943:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203840:12345-0@lo:503: Request processed in 440us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.833949:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785389898.834022:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203840:0@lo:503: 00000040:00080000:1.0:1785389898.834262:0:6594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785389898.834312:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203968:0@lo:502: 00000100:00100000:1.0:1785389898.834343:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.834407:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5356a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.844776:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879203968 00000100:00100000:0.0:1785389898.844792:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879203968 00000100:00100000:1.0:1785389898.854381:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785389898.854397:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203968:12345-0@lo:502: 00000100:00100000:1.0:1785389898.854884:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879203968:12345-0@lo:502: Request processed in 491us (20539us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389898.854892:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1785389898.854938:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879203968:0@lo:502: 00000040:00080000:0.0:1785389898.855222:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1785389898.855277:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1785389898.855313:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204096:0@lo:502: 00000100:00100000:0.0:1785389898.855369:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.865043:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785389898.873232:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204096 00000100:00100000:3.0:1785389898.873248:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204096 00000100:00100000:3.0:1785389898.873611:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1785389898.873619:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879204096:12345-0@lo:502: 00000100:00100000:3.0:1785389898.873867:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879204096:12345-0@lo:502: Request processed in 248us (18498us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389898.873874:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1785389898.874031:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204096:0@lo:502: 00000040:00080000:0.0:1785389898.874192:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1785389898.874207:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1785389898.875662:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785389898.875671:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389898.875674:0:6616:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785389898.875679:0:6616:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf5111bb800 00000020:00000080:0.0:1785389898.875682:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785389898.875696:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785389898.875698:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389898.875699:0:6616:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1785389898.875702:0:6616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1785389898.875921:0:6594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1785389898.875941:0:6594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785389898.875966:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.875976:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389898.876015:0:6594:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785389898.876018:0:6594:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf5111bb800 10000000:01000000:3.0:1785389898.876021:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf5111bb800 10000000:01000000:3.0:1785389898.876025:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785389898.876030:0:6594:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf5111bb800 from 1 10000000:01000000:3.0:1785389898.876033:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785389898.876071:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.876079:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.876088:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.876271:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204224:0@lo:101: 00000100:00100000:3.0:1785389898.876325:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.876425:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf530384180 going to sleep for 11 seconds 00000100:00100000:2.0:1785389898.876611:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204224 00000100:00100000:2.0:1785389898.876618:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204224 00000100:00100000:2.0:1785389898.876690:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785389898.876700:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879204224:12345-0@lo:101: 00010000:00010000:2.0:1785389898.876711:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389898.876723:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecaab expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.876745:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.876777:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389898.876787:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501528400, rc 0) 00000100:00100000:2.0:1785389898.876821:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204224:12345-0@lo:101: Request processed in 123us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.876828:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1785389898.876930:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204224:0@lo:101: 00010000:00010000:3.0:1785389898.876943:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389898.876952:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389898.877027:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204352:0@lo:501: 00000100:00100000:3.0:1785389898.877052:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.884294:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf530384180 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.884410:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204352 00000100:00100000:0.0:1785389898.884419:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204352 00000100:00100000:0.0:1785389898.884466:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1785389898.884474:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204352:12345-0@lo:501: 00000100:00100000:0.0:1785389898.884752:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204352:12345-0@lo:501: Request processed in 278us (7698us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.884760:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785389898.884850:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204352:0@lo:501: 00000100:00100000:3.0:1785389898.884892:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204480:0@lo:503: 00000100:00100000:3.0:1785389898.884948:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.884970:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf530384180 going to sleep for 11 seconds 00000100:00100000:2.0:1785389898.885019:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204480 00000100:00100000:2.0:1785389898.885023:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204480 00000100:00100000:2.0:1785389898.885044:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785389898.885049:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204480:12345-0@lo:503: 00000100:00100000:2.0:1785389898.885249:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204480:12345-0@lo:503: Request processed in 199us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.885255:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1785389898.885328:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204480:0@lo:503: 00000040:00080000:3.0:1785389898.885666:0:6594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785389898.885729:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204608:0@lo:502: 00000100:00100000:3.0:1785389898.885758:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.886239:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5237623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785389898.886582:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204608 00000100:00100000:2.0:1785389898.886587:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204608 00000100:00100000:2.0:1785389898.886608:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1785389898.886614:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204608:12345-0@lo:502: 00000100:00100000:2.0:1785389898.886774:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204608:12345-0@lo:502: Request processed in 150us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389898.886781:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785389898.887009:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204608:0@lo:502: 00000040:00080000:3.0:1785389898.887404:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1785389898.887454:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1785389898.887487:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1785389898.887572:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1785389898.887622:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1785389898.887672:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1785389898.887710:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1785389898.887741:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1785389898.887865:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1785389898.887901:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1785389898.887949:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1785389898.887999:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1785389898.888036:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1785389898.888071:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1785389898.892650:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1785389898.892727:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1785389898.892759:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1785389898.892798:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1785389898.892828:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1785389898.892857:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1785389898.892897:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1785389898.892940:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1785389898.892965:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1785389898.893002:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1785389898.893070:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1785389898.893194:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1785389898.893255:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1785389898.893291:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1785389898.893405:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204736:0@lo:502: 00000100:00100000:3.0:1785389898.893485:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389898.893563:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5237623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785389898.893613:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204736 00000100:00100000:1.0:1785389898.893629:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204736 00000100:00100000:1.0:1785389898.893673:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785389898.893682:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204736:12345-0@lo:502: 00000100:00100000:1.0:1785389898.893886:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879204736:12345-0@lo:502: Request processed in 204us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389898.893894:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785389898.893949:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879204736:0@lo:502: 00000040:00080000:3.0:1785389898.894012:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1785389898.894021:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1785389898.894789:0:6617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1785389898.894814:0:6617:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cf53f423380) 00000020:00000080:3.0:1785389898.894834:0:6617:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1785389898.895032:0:6617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf5111bb800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1785389898.895036:0:6617:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf5111bb800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1785389898.895038:0:6617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf5111bb800 3 00010000:00080000:3.0:1785389898.895073:0:6617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf53f42c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1785389898.899586:0:6617:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1785389898.899690:0:6617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1785389898.899724:0:6617:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785389898.899734:0:6617:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x33dffe75ff5ecac0 00000100:00080000:3.0:1785389898.899742:0:6617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785389898.899748:0:6617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf53f42c000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785389898.899787:0:6617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf535fbfb80 x1872116879204864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785389898.899816:0:6617:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1785389898.899943:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872116879204864:0@lo:38: 00000100:00100000:1.0:1785389898.900005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.900089:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879204992:0@lo:400: 00000100:00100000:1.0:1785389898.900112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.900147:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204864 00000100:00100000:1.0:1785389898.900154:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204864 00000100:00100000:1.0:1785389898.900176:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879204992 00000100:00100000:1.0:1785389898.900178:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879204992 00000100:00100000:1.0:1785389898.900198:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785389898.900205:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879204992:12345-0@lo:400: 00000100:00100000:1.0:1785389898.900258:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879204992:12345-0@lo:400: Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389898.900265:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785389898.900278:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785389898.900282:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1872116879204864:12345-0@lo:38: 00010000:00080000:1.0:1785389898.900298:0:5803:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1785389898.900324:0:5803:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x33dffe75ff5ecac7 00000004:00100000:1.0:1785389898.900338:0:5803:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1785389898.900374:0:5803:0:(import.c:65:import_set_state_nolock()) ffff8cf53f549000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785389898.900413:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872116879204864:12345-0@lo:38: Request processed in 129us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389898.900419:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785389898.900451:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf50de81500 x1872116879204992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389898.900464:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879204992:0@lo:400: 00010000:00080000:1.0:1785389898.900485:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf535fbfb80 x1872116879204864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785389908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389898.900696:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785389898.900702:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1785389898.900708:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1785389898.900712:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1785389898.900714:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf53f42c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1785389898.900720:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872116879204864:0@lo:38: 00000040:00080000:1.0:1785389898.902826:0:6617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1785389898.906337:0:6594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1785389898.906372:0:6594:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785389898.906405:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.906418:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1785389898.906465:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1785389898.906467:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785389898.906469:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389898.906470:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389898.906471:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389898.906472:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389898.906474:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785389898.906475:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389898.906476:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389898.906478:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389898.906479:0:6594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785389898.906483:0:6594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1785389898.906485:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785389898.906486:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785389898.906487:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389898.906489:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389898.906493:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389898.906494:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389898.906495:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785389898.906496:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389898.906497:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389898.906498:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389898.906499:0:6594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785389898.906538:0:6594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1785389898.906764:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879205120:0@lo:253: 00000100:00100000:1.0:1785389898.906830:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.906866:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785389898.907835:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205120 00000100:00100000:1.0:1785389898.907842:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205120 00000100:00100000:1.0:1785389898.907887:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1785389898.907894:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6594:x1872116879205120:12345-0@lo:253: 20000000:01000000:1.0:1785389898.907938:0:5795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1785389898.907951:0:5795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1785389898.977687:0:5795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1785389898.977709:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1785389898.980247:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785389898.980256:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785389898.980279:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.980296:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.980305:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.980352:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.980365:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 13 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389898.980396:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1872116879205248:0@lo:104: 00000100:00100000:1.0:1785389898.980452:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389898.980497:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562540 going to sleep for 11 seconds 00000100:00100000:0.0:1785389898.981299:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205248 00000100:00100000:0.0:1785389898.981307:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205248 00000100:00100000:0.0:1785389898.981377:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785389898.981386:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5818:x1872116879205248:12345-0@lo:104: 00010000:00010000:0.0:1785389898.981399:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.981455:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785389898.981461:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5818:x1872116879205248:12345-0@lo:104: Request processed in 77us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389898.981468:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1785389898.981488:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785389898.981493:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.981500:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5c00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:0.0:1785389898.981504:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.981512:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785389898.981519:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389898.981546:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1785389898.981573:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.981579:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785389898.981596:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.981613:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5c00/0x33dffe75ff5eca26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca2d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.981628:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389898.981630:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389898.981632:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389898.981650:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879205376:0@lo:103: 00000100:00100000:0.0:1785389898.981683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389898.981740:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1872116879205248:0@lo:104: 00010000:00010000:0.0:1785389898.981756:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389898.982578:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205376 00000100:00100000:1.0:1785389898.982584:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205376 00010000:00010000:1.0:1785389898.982603:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 14 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389898.982628:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785389898.982635:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e219450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:3310:x1872116879205376:12345-0@lo:103: 00010000:00010000:1.0:1785389898.982644:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785389898.982649:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 14 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982660:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 14 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982675:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529600/0x33dffe75ff5eca2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eca26 expref: 14 pid: 5795 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982688:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982695:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1785389898.982708:0:5789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002452837s 00010000:00010000:1.0:1785389898.982713:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982730:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982738:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982745:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982751:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785389898.982755:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982762:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982774:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389898.982782:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785389898.982811:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e219450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3310:x1872116879205376:12345-0@lo:103: Request processed in 177us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389898.982818:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785389898.983423:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879205376:0@lo:103: 00010000:00010000:0.0:1785389898.983443:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.983451:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389898.983457:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ecace lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389899.003830:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:6594:x1872116879205120:12345-0@lo:253: Request processed in 95929us (96994us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389899.003844:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1785389899.003940:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:6594:1872116879205120:0@lo:253: 10000000:01000000:1.0:1785389899.003955:0:6594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1785389899.003958:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785389899.003960:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785389899.003961:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389899.003963:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389899.003964:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389899.003977:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389899.003979:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785389899.003980:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389899.003982:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389899.003983:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389899.003985:0:6594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785389899.003998:0:6594:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785389899.017764:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785389899.017954:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785389899.019278:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785389899.019838:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785389899.020080:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1785389899.021842:0:6594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1785389899.025207:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1785389899.157613:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1785389899.529555:0:6594:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1785389899.529562:0:6594:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1785389899.529593:0:6594:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1785389899.529648:0:6594:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1785389899.529662:0:6594:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1785389899.529702:0:6594:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1785389900.186726:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785389901.210978:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785389901.210986:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf509225000 from 21 10000000:01000000:3.0:1785389901.210991:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785389901.211034:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.211045:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.211056:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389901.211078:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879205504:0@lo:101: 00000100:00100000:3.0:1785389901.211156:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389901.211208:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50317ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1785389901.212957:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205504 00000100:00100000:1.0:1785389901.212966:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205504 00000100:00100000:1.0:1785389901.213017:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1785389901.213026:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879205504:12345-0@lo:101: 00010000:00010000:1.0:1785389901.213041:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785389901.213055:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecad5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.213079:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.213090:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.213099:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4400, rc 0) 00000100:00100000:1.0:1785389901.213156:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879205504:12345-0@lo:101: Request processed in 131us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.213163:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1785389901.213210:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879205504:0@lo:101: 00010000:00010000:1.0:1785389901.213225:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.213234:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389901.213308:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879205632:0@lo:501: 00000100:00100000:1.0:1785389901.213335:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.213364:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f5620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.213436:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205632 00000100:00100000:3.0:1785389901.213441:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205632 00010000:00010000:2.0:1785389901.213628:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389901.213729:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1785389901.213737:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879205632:12345-0@lo:501: 00000100:00100000:3.0:1785389901.214064:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879205632:12345-0@lo:501: Request processed in 328us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389901.214072:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785389901.214123:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879205632:0@lo:501: 00000100:00100000:2.0:1785389901.214148:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879205760:0@lo:503: 00000100:00100000:2.0:1785389901.214182:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389901.217994:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535eada80 going to sleep for 11 seconds 00000100:00100000:1.0:1785389901.218071:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205760 00000100:00100000:1.0:1785389901.218079:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205760 00000100:00100000:1.0:1785389901.218122:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785389901.218131:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879205760:12345-0@lo:503: 00000100:00100000:1.0:1785389901.218471:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879205760:12345-0@lo:503: Request processed in 340us (4287us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.218479:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785389901.222291:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879205760:0@lo:503: 00000100:00100000:2.0:1785389901.222548:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6693:1872116879205888:0@lo:502: 00000100:00100000:2.0:1785389901.222609:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389901.222639:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535ead780 going to sleep for 11 seconds 00000100:00100000:1.0:1785389901.222693:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879205888 00000100:00100000:1.0:1785389901.222699:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879205888 00000100:00100000:1.0:1785389901.222729:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785389901.222737:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6693:x1872116879205888:12345-0@lo:502: 00000100:00100000:1.0:1785389901.223011:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6693:x1872116879205888:12345-0@lo:502: Request processed in 273us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.223019:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1785389901.223097:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6693:1872116879205888:0@lo:502: 00000100:00100000:2.0:1785389901.223133:0:6693:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6693:1872116879206016:0@lo:502: 00000100:00100000:2.0:1785389901.223164:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389901.223191:0:6693:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535ead780 going to sleep for 11 seconds 00000100:00100000:1.0:1785389901.223230:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206016 00000100:00100000:1.0:1785389901.223234:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206016 00000100:00100000:1.0:1785389901.223251:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785389901.223256:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6693:x1872116879206016:12345-0@lo:502: 00000100:00100000:1.0:1785389901.223375:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:6693:x1872116879206016:12345-0@lo:502: Request processed in 117us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.223382:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1785389901.223445:0:6693:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6693:1872116879206016:0@lo:502: 00000040:00080000:2.0:1785389901.223464:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1785389901.223610:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1785389901.223632:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785389901.223640:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.223651:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389901.223660:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1785389901.223662:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf509225000 from 4 10000000:01000000:1.0:1785389901.223665:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785389901.223691:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.223699:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.223707:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389901.223719:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206144:0@lo:101: 00000100:00100000:1.0:1785389901.223747:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.223774:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785389901.223813:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206144 00000100:00100000:2.0:1785389901.223818:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206144 00000100:00100000:2.0:1785389901.223836:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785389901.223842:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879206144:12345-0@lo:101: 00010000:00010000:2.0:1785389901.223856:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389901.223868:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecae3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389901.223897:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389901.223908:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389901.223917:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529e00, rc 0) 00000100:00100000:2.0:1785389901.223952:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879206144:12345-0@lo:101: Request processed in 110us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389901.223958:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785389901.224014:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206144:0@lo:101: 00010000:00010000:1.0:1785389901.224026:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.224035:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389901.224074:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206272:0@lo:256: 00000100:00100000:1.0:1785389901.224106:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.224127:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.224178:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206272 00000100:00100000:3.0:1785389901.224182:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206272 00000100:00100000:3.0:1785389901.224203:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785389901.224209:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879206272:12345-0@lo:256: 20000000:01000000:3.0:1785389901.224222:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1785389901.224238:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1785389901.224242:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1785389901.224322:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879206272:12345-0@lo:256: Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389901.224329:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1785389901.224642:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206272:0@lo:256: 10000000:01000000:1.0:1785389901.224680:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785389901.224685:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.224693:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389901.224700:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1785389901.224702:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1785389901.224704:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1785389901.224719:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.224726:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.224734:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389901.224745:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206400:0@lo:101: 00000100:00100000:1.0:1785389901.224769:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.224793:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.224832:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206400 00000100:00100000:3.0:1785389901.224836:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206400 00000100:00100000:3.0:1785389901.224852:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1785389901.224858:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879206400:12345-0@lo:101: 00010000:00010000:3.0:1785389901.224864:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389901.224872:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecaf1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.224898:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.224914:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.224921:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fc400, rc 0) 00000100:00100000:3.0:1785389901.225025:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879206400:12345-0@lo:101: Request processed in 166us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389901.225031:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785389901.227658:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206400:0@lo:101: 00010000:00010000:1.0:1785389901.227678:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389901.227704:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389901.227768:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206528:0@lo:501: 00000100:00100000:1.0:1785389901.227810:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.227893:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785389901.232165:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206528 00000100:00100000:2.0:1785389901.232177:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206528 00000100:00100000:0.0:1785389901.234252:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785389901.234277:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879206528:12345-0@lo:501: 00000100:00100000:0.0:1785389901.234586:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879206528:12345-0@lo:501: Request processed in 311us (6775us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389901.234594:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785389901.234679:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206528:0@lo:501: 00000100:00100000:1.0:1785389901.234726:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206656:0@lo:503: 00000100:00100000:1.0:1785389901.234770:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.240694:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.240764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206656 00000100:00100000:3.0:1785389901.240773:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206656 00000100:00100000:2.0:1785389901.240837:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1785389901.240848:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879206656:12345-0@lo:503: 00000100:00100000:2.0:1785389901.243174:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879206656:12345-0@lo:503: Request processed in 2323us (8398us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389901.243186:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785389901.243346:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879206656:0@lo:503: 00000100:00100000:1.0:1785389901.243725:0:6694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6694:1872116879206784:0@lo:502: 00000100:00100000:1.0:1785389901.243769:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.243838:0:6694:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562900 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.245377:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206784 00000100:00100000:3.0:1785389901.245385:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206784 00000100:00100000:3.0:1785389901.245416:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1785389901.245425:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:6694:x1872116879206784:12345-0@lo:502: 00000100:00100000:3.0:1785389901.245707:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:6694:x1872116879206784:12345-0@lo:502: Request processed in 282us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389901.245714:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785389901.245832:0:6694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6694:1872116879206784:0@lo:502: 00000020:01000000:1.0:1785389901.245858:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785389901.245866:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1785389901.245874:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785389901.245876:0:6694:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1785389901.245894:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1785389901.245898:0:6694:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:1.0:1785389901.245919:0:6694:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1785389901.245921:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785389901.245936:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cf50ddf8000) 00000020:00000080:1.0:1785389901.245955:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1785389901.245966:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1785389901.246044:0:6694:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1785389901.246049:0:6694:0:(osd_handler.c:1572:osd_obd_connect()) connect #5 00000020:00000080:1.0:1785389901.246055:0:6694:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ecb06 00010000:00080000:1.0:1785389901.246143:0:6694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf503e36800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1785389901.246355:0:6694:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1785389901.293797:0:6694:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1785389901.293828:0:6694:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785389901.294848:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785389901.295021:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785389901.295071:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1785389901.295127:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1785389901.298757:0:6697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785389901.298766:0:6697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1785389901.302472:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1785389901.302487:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1785389901.302731:0:6694:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1785389901.304631:0:6694:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5ecb0d 00000100:00080000:3.0:1785389901.304644:0:6694:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785389901.304650:0:6694:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf503e36800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785389901.304687:0:6694:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf535fbf800 x1872116879206912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785389901.304710:0:6694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1785389901.304781:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879207040:0@lo:400: 00000100:00100000:3.0:1785389901.304850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389901.305455:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879206912:0@lo:8: 00000100:00100000:0.0:1785389901.305494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389901.305548:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879206912 00000100:00100000:0.0:1785389901.305554:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879206912 00000100:00100000:0.0:1785389901.305585:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389901.305594:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879206912:12345-0@lo:8: 00010000:00080000:0.0:1785389901.305618:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1785389901.305645:0:6597:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5ecb14 00002000:00100000:0.0:1785389901.305679:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cf53b944800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1785389901.305683:0:6597:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1785389901.305687:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1785389901.305814:0:6597:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1785389901.306038:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785389901.306062:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf53b940800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785389901.306113:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1872116879206912:12345-0@lo:8: Request processed in 520us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389901.306121:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785389901.306282:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785389901.306290:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879207168:0@lo:400: 00000100:00100000:3.0:1785389901.306323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389901.306355:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207040 00000100:00100000:3.0:1785389901.306359:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207040 00000100:00100000:3.0:1785389901.306424:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207168 00000100:00100000:3.0:1785389901.306428:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207168 00010000:00080000:0.0:1785389901.306497:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbf800 x1872116879206912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785389911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389901.306507:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785389901.306515:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1785389901.306521:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1785389901.306584:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1785389901.306587:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf503e36800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1785389901.306597:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1785389901.306602:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879206912:0@lo:8: 00000004:00080000:0.0:1785389901.307585:0:6697:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785389901.307697:0:6697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209862171721ns, next at 0ns, rc = 0 00000100:00100000:2.0:1785389901.312982:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785389901.313002:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879207040:12345-0@lo:400: 00000100:00100000:2.0:1785389901.313089:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879207040:12345-0@lo:400: Request processed in 95us (8238us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389901.313097:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785389901.313119:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785389901.313127:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879207168:12345-0@lo:400: 00000100:00100000:2.0:1785389901.313170:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879207168:12345-0@lo:400: Request processed in 44us (6846us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389901.313176:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1785389901.314223:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785389901.314277:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbdf80 x1872116879207168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389901.314295:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879207168:0@lo:400: 00010000:00080000:3.0:1785389901.314318:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbd500 x1872116879207040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389901.314327:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879207040:0@lo:400: 00000020:01000000:3.0:1785389901.314447:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389901.314920:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389901.314924:0:6694:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1785389901.314928:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785389901.314933:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389901.314935:0:6694:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785389901.314938:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785389901.314941:0:6694:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1785389901.314974:0:6694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6694:1872116879207296:0@lo:502: 00000100:00100000:3.0:1785389901.315032:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389901.315063:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207296 00000100:00100000:3.0:1785389901.315069:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207296 00000100:00100000:3.0:1785389901.315101:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1785389901.315108:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:6694:x1872116879207296:12345-0@lo:502: 00000100:00100000:3.0:1785389901.315302:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:6694:x1872116879207296:12345-0@lo:502: Request processed in 193us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389901.315310:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1785389901.315355:0:6694:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.315368:0:6694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:6694:1872116879207296:0@lo:502: 00000020:01000000:3.0:1785389901.315388:0:6694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389901.315392:0:6694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389901.315393:0:6694:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785389901.315397:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1785389901.315441:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1785389901.315456:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1785389901.315467:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315477:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389901.315487:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1785389901.315489:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf50ddfb380 from 1 10000000:01000000:3.0:1785389901.315492:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1785389901.315513:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315538:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315548:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389901.315560:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879207424:0@lo:101: 00000100:00100000:3.0:1785389901.315593:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389901.315609:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.315623:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207424 00000100:00100000:3.0:1785389901.315626:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207424 00000100:00100000:3.0:1785389901.315645:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1785389901.315651:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879207424:12345-0@lo:101: 00010000:00010000:3.0:1785389901.315660:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389901.315671:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecb1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315691:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315701:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315708:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fd600, rc 0) 00000100:00100000:3.0:1785389901.315736:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879207424:12345-0@lo:101: Request processed in 85us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389901.315742:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1785389901.315772:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879207424:0@lo:101: 00010000:00010000:3.0:1785389901.315784:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.315793:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389901.315830:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879207552:0@lo:501: 00000100:00100000:3.0:1785389901.315861:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389901.315873:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389901.315898:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207552 00000100:00100000:3.0:1785389901.315902:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207552 00000100:00100000:3.0:1785389901.315922:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785389901.315928:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879207552:12345-0@lo:501: 00000100:00100000:3.0:1785389901.316082:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879207552:12345-0@lo:501: Request processed in 153us (219us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785389901.316089:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785389901.316117:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879207552:0@lo:501: 10000000:01000000:3.0:1785389901.316132:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1785389901.316138:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389901.316145:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785389901.426488:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1785389901.523946:0:6698:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1785389901.523977:0:6698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879207808:0@lo:7: 00000100:00100000:0.0:1785389901.524046:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389901.524098:0:6698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49900 going to sleep for 11 seconds 00000100:00100000:0.0:1785389901.524120:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207808 00000100:00100000:0.0:1785389901.524126:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207808 00000100:00100000:0.0:1785389901.524173:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785389901.524180:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6698:x1872116879207808:12345-0@lo:7: 00000100:00100000:3.0:1785389901.527094:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785389901.527114:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879207680:0@lo:13: 00000100:00100000:3.0:1785389901.527218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1785389901.529626:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785389901.533005:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207680 00000100:00100000:1.0:1785389901.533019:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207680 00000100:00100000:1.0:1785389901.533079:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785389901.533089:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879207680:12345-0@lo:13: 00002000:00000024:1.0:1785389901.533126:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1785389901.533208:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879207680:12345-0@lo:13: Request processed in 121us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.533216:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785389901.533264:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a354000 x1872116879207680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389901.533283:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879207680:0@lo:13: 00002000:00080000:0.0:1785389901.535383:0:6599:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1785389901.535390:0:6599:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1785389901.535459:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6698:x1872116879207808:12345-0@lo:7: Request processed in 11276us (11410us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389901.535468:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1785389901.536978:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a356680 x1872116879207808/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785389917 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389901.536995:0:6698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879207808:0@lo:7: 00000004:00080000:1.0:1785389901.537020:0:6698:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1785389901.537060:0:6698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879207936:0@lo:5: 00000100:00100000:1.0:1785389901.537102:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.537157:0:6698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf523853480 going to sleep for 11 seconds 00000100:00100000:1.0:1785389901.537182:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879207936 00000100:00100000:1.0:1785389901.537188:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879207936 00000100:00100000:1.0:1785389901.537227:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785389901.537235:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6698:x1872116879207936:12345-0@lo:5: 00002000:00080000:1.0:1785389901.537259:0:6598:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1785389901.537263:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1785389901.537503:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6698:x1872116879207936:12345-0@lo:5: Request processed in 268us (400us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1785389901.537510:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785389901.537566:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf50de82a00 x1872116879207936/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785389917 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389901.537578:0:6698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de82a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879207936:0@lo:5: 00000004:00080000:1.0:1785389901.537587:0:6698:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1785389901.537610:0:6698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879208064:0@lo:700: 00000100:00100000:1.0:1785389901.537633:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.537647:0:6698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf523762600 going to sleep for 11 seconds 00000100:00100000:0.0:1785389901.542979:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208064 00000100:00100000:0.0:1785389901.542992:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208064 00000100:00100000:0.0:1785389901.543043:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389901.543052:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6698:x1872116879208064:12345-0@lo:700: 00000100:00100000:0.0:1785389901.543105:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6605:1872116879208192:0@lo:700: 00000100:00100000:0.0:1785389901.543184:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389901.543224:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785389901.543245:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208192 00000100:00100000:0.0:1785389901.543254:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208192 00000100:00100000:0.0:1785389901.543283:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389901.543290:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6605:x1872116879208192:12345-0@lo:700: 40000000:02000000:1.0:1785389901.582684:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1785389901.605621:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6605:x1872116879208192:12345-0@lo:700: Request processed in 62324us (62429us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.605641:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1785389901.605692:0:6605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357480 x1872116879208192/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785389917 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389901.605718:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6605:1872116879208192:0@lo:700: 40000000:02000000:1.0:1785389901.605730:0:6605:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1785389901.762555:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1785389901.762574:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1785389901.763743:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6698:x1872116879208064:12345-0@lo:700: Request processed in 220688us (226105us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389901.763771:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1785389901.763950:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf50de80700 x1872116879208064/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785389917 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389901.763963:0:6698:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1785389901.763979:0:6698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879208064:0@lo:700: 00000004:02000040:2.0:1785389901.814821:0:6698:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1785389901.823462:0:6698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879208320:0@lo:5: 00000100:00100000:3.0:1785389901.823555:0:6698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389901.823687:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208320 00000100:00100000:1.0:1785389901.823696:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208320 00000100:00100000:1.0:1785389901.823748:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785389901.823757:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6698:x1872116879208320:12345-0@lo:5: 00000100:00100000:3.0:1785389901.825152:0:6698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019c00 going to sleep for 11 seconds 00002000:00080000:3.0:1785389901.838731:0:6599:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1785389901.838760:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1785389901.841172:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6698:x1872116879208320:12345-0@lo:5: Request processed in 17411us (17612us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785389901.841188:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1785389901.843111:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbdf80 x1872116879208320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785389917 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389901.843130:0:6698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6698:1872116879208320:0@lo:5: 00000004:00080000:2.0:1785389901.843144:0:6698:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1785389902.229939:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389903.256261:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389904.279732:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389905.302554:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389906.326094:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389906.457485:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879208576:0@lo:400: 00000100:00100000:0.0:1785389906.457585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389906.457643:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785389906.457650:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879208704:0@lo:400: 00000100:00100000:0.0:1785389906.457685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389906.457733:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208576 00000100:00100000:0.0:1785389906.457740:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208576 00000100:00100000:0.0:1785389906.459109:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208704 00000100:00100000:0.0:1785389906.459116:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208704 00000100:00100000:0.0:1785389906.459148:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785389906.459157:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879208576:12345-0@lo:400: 00000100:00100000:0.0:1785389906.459218:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879208576:12345-0@lo:400: Request processed in 63us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389906.459225:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1785389906.459238:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785389906.459244:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879208704:12345-0@lo:400: 00000100:00100000:0.0:1785389906.459267:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879208704:12345-0@lo:400: Request processed in 24us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389906.459273:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1785389906.459291:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785389906.459319:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357480 x1872116879208704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389906.459333:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879208704:0@lo:400: 00010000:00080000:0.0:1785389906.459374:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357800 x1872116879208576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389906.459383:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879208576:0@lo:400: 00000100:00100000:2.0:1785389906.460457:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879208448:0@lo:400: 00000100:00100000:2.0:1785389906.460498:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389906.460561:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785389906.460568:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879208832:0@lo:400: 00000100:00100000:2.0:1785389906.460594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389906.460853:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208448 00000100:00100000:0.0:1785389906.460858:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208448 00000100:00100000:0.0:1785389906.460897:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785389906.460905:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3310:x1872116879208448:12345-0@lo:400: 00000100:00100000:0.0:1785389906.460943:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3310:x1872116879208448:12345-0@lo:400: Request processed in 39us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389906.460950:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785389906.460978:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208832 00000100:00100000:0.0:1785389906.460982:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208832 00000100:00100000:0.0:1785389906.461011:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785389906.461018:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879208832:12345-0@lo:400: 00000100:00100000:0.0:1785389906.461050:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879208832:12345-0@lo:400: Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389906.461056:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1785389906.461071:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785389906.461180:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a356680 x1872116879208832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389906.461192:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879208832:0@lo:400: 00000100:00100000:2.0:1785389906.461201:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879208448:0@lo:400: 00000100:00100000:2.0:1785389906.974219:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785389906.974245:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879208960:0@lo:13: 00000100:00100000:2.0:1785389906.974313:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389906.975454:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879208960 00000100:00100000:1.0:1785389906.975462:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879208960 00000100:00100000:1.0:1785389906.975500:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785389906.975508:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879208960:12345-0@lo:13: 00002000:00000024:1.0:1785389906.975552:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389906.975599:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879208960:12345-0@lo:13: Request processed in 91us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389906.975606:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1785389906.975739:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a890700 x1872116879208960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389906.975758:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879208960:0@lo:13: 00000001:00080000:0.0:1785389907.060358:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:3.0:1785389907.297310:0:6967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785389907.350267:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389908.374391:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389909.397745:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389910.426692:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389911.447330:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389911.578497:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879209216:0@lo:400: 00000100:00100000:1.0:1785389911.578654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389911.578712:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785389911.578718:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879209088:0@lo:400: 00000100:00100000:1.0:1785389911.578745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389911.578782:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879209344:0@lo:400: 00000100:00100000:1.0:1785389911.578818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389911.578837:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785389911.578843:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879209472:0@lo:400: 00000100:00100000:1.0:1785389911.578867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389911.578896:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209088 00000100:00100000:1.0:1785389911.578902:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209088 00000100:00100000:1.0:1785389911.578940:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785389911.578948:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3308:x1872116879209088:12345-0@lo:400: 00000100:00100000:3.0:1785389911.579076:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209216 00000100:00100000:3.0:1785389911.579080:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209216 00000100:00100000:3.0:1785389911.579105:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209344 00000100:00100000:3.0:1785389911.579107:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209344 00000100:00100000:3.0:1785389911.579124:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785389911.579130:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879209216:12345-0@lo:400: 00000100:00100000:1.0:1785389911.579183:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3308:x1872116879209088:12345-0@lo:400: Request processed in 235us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389911.579191:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785389911.579218:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1785389911.579225:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1785389911.579238:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209472 00000100:00100000:1.0:1785389911.579241:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209472 00000100:00100000:1.0:1785389911.579264:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785389911.579269:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879209472:12345-0@lo:400: 00000100:00100000:1.0:1785389911.579298:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879209472:12345-0@lo:400: Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389911.579303:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1785389911.582767:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785389911.582775:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389911.584087:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1785389911.584109:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785389911.584122:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879209344:12345-0@lo:400: 00000100:00100000:2.0:1785389911.584206:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879209344:12345-0@lo:400: Request processed in 88us (5386us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389911.584213:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785389911.584686:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879209216:12345-0@lo:400: Request processed in 5554us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389911.584694:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1785389911.587835:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbe300 x1872116879209472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389911.587849:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1785389911.587867:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879209472:0@lo:400: 00010000:00080000:2.0:1785389911.587884:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbc700 x1872116879209344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389911.587892:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879209344:0@lo:400: 00000100:00100000:1.0:1785389911.592140:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879209088:0@lo:400: 00010000:00080000:0.0:1785389911.600102:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbf100 x1872116879209216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389911.600123:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879209216:0@lo:400: 00000100:00100000:2.0:1785389912.086907:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879209600:0@lo:13: 00000100:00100000:2.0:1785389912.086995:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389912.088930:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209600 00000100:00100000:3.0:1785389912.088941:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209600 00000100:00100000:3.0:1785389912.089002:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785389912.089012:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879209600:12345-0@lo:13: 00002000:00000024:3.0:1785389912.089045:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785389912.089115:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879209600:12345-0@lo:13: Request processed in 105us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389912.089122:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1785389912.089271:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf535fbea00 x1872116879209600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389912.089290:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879209600:0@lo:13: 00010000:00010000:2.0:1785389912.470686:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389913.494273:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389914.544918:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389915.605747:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389916.638193:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389916.700318:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879209728:0@lo:400: 00000100:00100000:0.0:1785389916.700416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389916.700553:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879209856:0@lo:400: 00000100:00100000:0.0:1785389916.700797:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785389916.700805:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879210112:0@lo:400: 00000100:00100000:1.0:1785389916.701618:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879209984:0@lo:400: 00000100:00100000:2.0:1785389916.703738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389916.706968:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209856 00000100:00100000:3.0:1785389916.706988:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209856 00000100:00100000:3.0:1785389916.707076:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785389916.707087:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879209856:12345-0@lo:400: 00000100:00100000:3.0:1785389916.707211:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879209856:12345-0@lo:400: Request processed in 126us (3479us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389916.707219:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1785389916.708137:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357480 x1872116879209856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389916.708156:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879209856:0@lo:400: 00000100:00100000:0.0:1785389916.710719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389916.710815:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209728 00000100:00100000:0.0:1785389916.710826:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209728 00000100:00100000:0.0:1785389916.710889:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785389916.710900:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3308:x1872116879209728:12345-0@lo:400: 00000100:00100000:2.0:1785389916.712081:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210112 00000100:00100000:2.0:1785389916.712091:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210112 00000100:00100000:2.0:1785389916.712150:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785389916.712159:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879210112:12345-0@lo:400: 00000100:00100000:2.0:1785389916.712244:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879210112:12345-0@lo:400: Request processed in 86us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389916.712252:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1785389916.713188:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785389916.713246:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357100 x1872116879210112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389916.713263:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879210112:0@lo:400: 00000100:00100000:0.0:1785389916.713619:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3308:x1872116879209728:12345-0@lo:400: Request processed in 2719us (13201us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389916.713631:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785389916.713763:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879209728:0@lo:400: 00000100:00100000:1.0:1785389916.721207:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389916.729681:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879209984 00000100:00100000:0.0:1785389916.729703:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879209984 00000100:00100000:1.0:1785389916.747379:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785389916.747398:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879209984:12345-0@lo:400: 00000100:00100000:1.0:1785389916.747571:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879209984:12345-0@lo:400: Request processed in 177us (26376us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389916.747580:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1785389916.747650:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a354e00 x1872116879209984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389916.747669:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879209984:0@lo:400: 00000100:00080000:0.0:1785389916.747805:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389917.211038:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785389917.211072:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879210240:0@lo:13: 00000100:00100000:1.0:1785389917.211167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389917.211682:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210240 00000100:00100000:0.0:1785389917.211701:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210240 00000100:00100000:0.0:1785389917.211767:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785389917.211779:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879210240:12345-0@lo:13: 00002000:00000024:0.0:1785389917.211821:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389917.211887:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879210240:12345-0@lo:13: Request processed in 110us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389917.211894:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1785389917.212051:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a354380 x1872116879210240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389917.212074:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879210240:0@lo:13: 00010000:00010000:2.0:1785389917.653730:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389918.688260:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389919.709311:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389920.732087:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389921.761930:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389921.814786:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879210624:0@lo:400: 00000100:00100000:0.0:1785389921.814870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389921.814963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210624 00000100:00100000:0.0:1785389921.814976:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210624 00000100:00100000:0.0:1785389921.815050:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785389921.815059:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879210624:12345-0@lo:400: 00000100:00100000:0.0:1785389921.815147:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879210624:12345-0@lo:400: Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389921.815154:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1785389921.815203:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1785389921.815238:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a355c00 x1872116879210624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389921.815255:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879210624:0@lo:400: 00000100:00100000:0.0:1785389921.815293:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879210752:0@lo:400: 00000100:00100000:0.0:1785389921.815321:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389921.815352:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210752 00000100:00100000:0.0:1785389921.815355:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210752 00000100:00100000:0.0:1785389921.815384:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785389921.815389:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879210752:12345-0@lo:400: 00000100:00100000:0.0:1785389921.815433:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879210752:12345-0@lo:400: Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389921.815440:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1785389921.815455:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785389921.815470:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a355c00 x1872116879210752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389921.815480:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879210752:0@lo:400: 00000100:00100000:1.0:1785389921.815650:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879210368:0@lo:400: 00000100:00100000:1.0:1785389921.815684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389921.815722:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785389921.815727:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879210496:0@lo:400: 00000100:00100000:1.0:1785389921.815747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389921.815801:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210496 00000100:00100000:2.0:1785389921.815806:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210496 00000100:00100000:2.0:1785389921.815837:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1785389921.815844:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879210496:12345-0@lo:400: 00000100:00100000:2.0:1785389921.815889:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879210496:12345-0@lo:400: Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389921.815895:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1785389921.815920:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a356a00 x1872116879210496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389921.815929:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879210496:0@lo:400: 00000100:00100000:0.0:1785389921.816109:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210368 00000100:00100000:0.0:1785389921.816112:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210368 00000100:00100000:0.0:1785389921.816143:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1785389921.816149:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3309:x1872116879210368:12345-0@lo:400: 00000100:00100000:0.0:1785389921.816188:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3309:x1872116879210368:12345-0@lo:400: Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389921.816203:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785389921.816289:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879210368:0@lo:400: 00000100:00100000:0.0:1785389922.326577:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879210880:0@lo:13: 00000100:00100000:0.0:1785389922.326670:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389922.326731:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879210880 00000100:00100000:2.0:1785389922.326742:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879210880 00000100:00100000:2.0:1785389922.326805:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785389922.326817:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879210880:12345-0@lo:13: 00002000:00000024:2.0:1785389922.326860:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785389922.326924:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879210880:12345-0@lo:13: Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389922.326932:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1785389922.326971:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a355c00 x1872116879210880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389922.326991:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879210880:0@lo:13: 00010000:00010000:2.0:1785389922.773876:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1785389923.190116:0:7489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1785389923.190122:0:7489:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1785389923.190274:0:7489:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cf53b946000 00000020:01000004:0.0:1785389923.190311:0:7489:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1785389923.190326:0:7489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1785389923.190360:0:7489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cf50e2c19c0) 00000020:00000080:0.0:1785389923.190377:0:7489:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1785389923.238636:0:7489:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1785389923.238904:0:7489:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1785389923.306602:0:7489:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1785389923.326348:0:7489:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1785389923.326389:0:7489:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1785389923.326456:0:7489:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1785389923.326488:0:7489:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1785389923.326926:0:7489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785389923.326941:0:7489:0:(osd_handler.c:1572:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785389923.326954:0:7489:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33dffe75ff5ecb30 00000020:01000004:3.0:1785389923.326963:0:7489:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785389923.326987:0:7489:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785389923.326991:0:7489:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785389923.326998:0:7489:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785389923.327023:0:7489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785389923.327029:0:7489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1785389923.383505:0:7489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785389923.383580:0:7489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1785389923.383585:0:7489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785389923.383587:0:7489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785389923.383593:0:7489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389923.383594:0:7489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389923.383595:0:7489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389923.383597:0:7489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389923.383599:0:7489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785389923.383600:0:7489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389923.383601:0:7489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389923.383603:0:7489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389923.383604:0:7489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785389923.383609:0:7489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1785389923.383611:0:7489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785389923.383612:0:7489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785389923.383613:0:7489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389923.383615:0:7489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785389923.383616:0:7489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389923.383617:0:7489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389923.383618:0:7489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785389923.383619:0:7489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1785389923.383620:0:7489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1785389923.383621:0:7489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389923.383622:0:7489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785389923.383655:0:7489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1785389923.383676:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879211008:0@lo:253: 00000100:00100000:1.0:1785389923.383782:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389923.383844:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785389923.384237:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211008 00000100:00100000:2.0:1785389923.384247:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211008 00000100:00100000:2.0:1785389923.384307:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785389923.384317:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:7489:x1872116879211008:12345-0@lo:253: 20000000:01000000:2.0:1785389923.384353:0:5795:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1785389923.384357:0:5795:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1785389923.384363:0:5795:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1785389923.384367:0:5795:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1785389923.385344:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785389923.385596:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1785389923.385610:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1785389923.385645:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1785389923.385652:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1785389923.385702:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1785389923.385751:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1785389923.386112:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1785389923.386131:0:5795:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:2.0:1785389923.386133:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:2.0:1785389923.386161:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1785389923.386168:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1785389923.386207:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1785389923.386213:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1785389923.386239:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1785389923.386248:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1785389923.386272:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1785389923.386311:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1785389923.387042:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1785389923.387056:0:5795:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.154@tcp 20000000:01000000:2.0:1785389923.387058:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.154@tcp (null) (null) (null) 00000040:00080000:2.0:1785389923.387087:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1785389923.387094:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1785389923.387136:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1785389923.387143:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.154@tcp (null) (null) 00000040:00080000:2.0:1785389923.387170:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1785389923.387177:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1785389923.387229:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1785389923.387265:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1785389923.387280:0:5795:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1785389923.387283:0:5795:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1785389923.387290:0:5795:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1785389923.387292:0:5795:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1785389923.387295:0:5795:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1785389923.387307:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785389923.387310:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1785389923.387344:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1785389923.387350:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785389923.396084:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1785389923.396254:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1785389923.396292:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1785389923.396739:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1785389923.396789:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1785389923.396860:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1785389923.396878:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1785389923.396881:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1785389923.398793:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1785389923.399100:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1785389923.399141:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1785389923.399207:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1785389923.399220:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1785389923.399222:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1785389923.399836:0:7493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1785389923.399884:0:7493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1785389923.400054:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1785389923.400260:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1785389923.400292:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1785389923.400346:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1785389923.400359:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1785389923.400362:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1785389923.406174:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1785389923.406277:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1785389923.406327:0:7494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1785389923.406751:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1785389923.406796:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1785389923.406826:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1785389923.406848:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785389923.406871:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406893:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406910:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406918:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406925:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406933:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406942:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.406989:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.407005:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 16 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.407024:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211136:0@lo:104: 00000100:00100000:0.0:1785389923.407109:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785389923.407164:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.407173:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 16 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.407182:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211264:0@lo:104: 00010000:00010000:0.0:1785389923.407211:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.407220:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 16 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.407228:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211392:0@lo:104: 00000100:00100000:1.0:1785389923.407246:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1785389923.407251:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.407259:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 16 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389923.407265:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.407266:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211520:0@lo:104: 00000100:00100000:0.0:1785389923.407286:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389923.407362:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211136 00000100:00100000:2.0:1785389923.407371:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211136 00000100:00100000:2.0:1785389923.407409:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211264 00000100:00100000:2.0:1785389923.407413:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211264 00000100:00100000:2.0:1785389923.407422:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211520 00000100:00100000:2.0:1785389923.407424:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211520 00000100:00100000:2.0:1785389923.407437:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785389923.407447:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf510fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:5795:x1872116879211136:12345-0@lo:104: 00010000:00010000:2.0:1785389923.407461:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411537:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1785389923.411556:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf510fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:5795:x1872116879211136:12345-0@lo:104: Request processed in 4104us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.411569:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785389923.411659:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785389923.411669:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:5795:x1872116879211264:12345-0@lo:104: 00010000:00010000:2.0:1785389923.411696:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411746:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1785389923.411750:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:5795:x1872116879211264:12345-0@lo:104: Request processed in 86us (4485us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.411755:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785389923.411767:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785389923.411773:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5795:x1872116879211520:12345-0@lo:104: 00010000:00010000:2.0:1785389923.411780:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411801:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1785389923.411805:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5795:x1872116879211520:12345-0@lo:104: Request processed in 33us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.411809:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1785389923.411845:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785389923.411851:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411859:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fd000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785389923.411865:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411874:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785389923.411893:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389923.411898:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785389923.411944:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411951:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785389923.411973:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411981:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecb1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb22 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.411995:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785389923.411999:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412005:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785389923.412008:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412014:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785389923.412022:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389923.412028:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785389923.412047:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412053:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785389923.412067:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412074:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4000/0x33dffe75ff5ecaf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaf8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412083:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785389923.412086:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412091:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fc800 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785389923.412094:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412100:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785389923.412105:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389923.412110:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1785389923.412119:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412124:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785389923.412129:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412144:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5013fc800/0x33dffe75ff5ecaab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecab2 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.412158:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389923.412160:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389923.412162:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389923.418134:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389923.418192:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211392 00000100:00100000:1.0:1785389923.418203:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211392 00000100:00100000:1.0:1785389923.418258:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785389923.418268:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5795:x1872116879211392:12345-0@lo:104: 00010000:00010000:1.0:1785389923.419556:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.419672:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785389923.419707:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5795:x1872116879211392:12345-0@lo:104: Request processed in 1438us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.419715:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1785389923.419754:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785389923.419761:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.419768:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fce00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389923.419772:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.419782:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389923.419789:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389923.419795:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1785389923.419837:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.419844:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785389923.419858:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.419866:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecadc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.420591:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389923.420593:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389923.420595:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389923.422154:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879211648:0@lo:103: 00000100:00100000:1.0:1785389923.422228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389923.422280:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785389923.422287:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879212032:0@lo:103: 00000100:00100000:1.0:1785389923.422554:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785389923.422588:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389923.423302:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211648 00000100:00100000:2.0:1785389923.423314:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211648 00010000:00010000:2.0:1785389923.423358:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 17 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389923.423402:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212032 00000100:00100000:2.0:1785389923.423405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212032 00010000:00010000:2.0:1785389923.423417:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 18 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389923.423433:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785389923.423443:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:3310:x1872116879211648:12345-0@lo:103: 00010000:00010000:2.0:1785389923.423460:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785389923.423467:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 18 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.423480:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 18 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.423505:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785389923.423568:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:3310:x1872116879211648:12345-0@lo:103: Request processed in 126us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.423576:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785389923.423610:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785389923.423617:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3310:x1872116879212032:12345-0@lo:103: 00010000:00010000:2.0:1785389923.423625:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785389923.423630:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 17 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.423639:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 17 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.423648:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785389923.423666:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879211648:0@lo:103: 00000100:00100000:2.0:1785389923.423669:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3310:x1872116879212032:12345-0@lo:103: Request processed in 53us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.423674:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785389923.423705:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879212032:0@lo:103: 00000100:00100000:2.0:1785389923.424599:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879211776:0@lo:103: 00000100:00100000:2.0:1785389923.424643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389923.424691:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389923.424698:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879211904:0@lo:103: 00000100:00100000:2.0:1785389923.424719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389923.424796:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211776 00000100:00100000:3.0:1785389923.424802:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211776 00010000:00010000:3.0:1785389923.424827:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 17 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389923.424852:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879211904 00000100:00100000:3.0:1785389923.424855:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879211904 00010000:00010000:3.0:1785389923.424865:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 18 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389923.424895:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785389923.424902:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:3307:x1872116879211776:12345-0@lo:103: 00010000:00010000:3.0:1785389923.424911:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389923.424915:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 18 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.424926:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 18 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.424939:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389923.424969:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:3307:x1872116879211776:12345-0@lo:103: Request processed in 68us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.424975:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785389923.424990:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785389923.424995:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3307:x1872116879211904:12345-0@lo:103: 00010000:00010000:3.0:1785389923.425002:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389923.425006:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 17 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.425013:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 17 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.425022:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389923.425040:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3307:x1872116879211904:12345-0@lo:103: Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.425046:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785389923.425118:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879211904:0@lo:103: 00000100:00100000:2.0:1785389923.425128:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879211776:0@lo:103: 00010000:00010000:0.0:1785389923.426709:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.426729:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 16 pid: 5795 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.426742:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879212160:0@lo:104: 00000100:00100000:0.0:1785389923.426781:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.426805:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859c00 going to sleep for 11 seconds 00010000:00010000:0.0:1785389923.426823:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecb22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecb1b expref: 16 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.426835:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211136:0@lo:104: 00010000:00010000:0.0:1785389923.426844:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecaf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecaf1 expref: 15 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.426874:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211264:0@lo:104: 00010000:00010000:0.0:1785389923.426887:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ecadc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecad5 expref: 14 pid: 5798 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.426896:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211392:0@lo:104: 00010000:00010000:0.0:1785389923.426906:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecaab expref: 13 pid: 5797 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.426915:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879211520:0@lo:104: 00000100:00100000:1.0:1785389923.426954:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212160 00000100:00100000:1.0:1785389923.426960:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212160 00000100:00100000:1.0:1785389923.427042:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785389923.427049:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5795:x1872116879212160:12345-0@lo:104: 00010000:00010000:1.0:1785389923.427063:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.427226:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1872116879212160:0@lo:104: 00010000:00010000:0.0:1785389923.427261:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.427582:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785389923.427590:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5795:x1872116879212160:12345-0@lo:104: Request processed in 540us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.427597:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1785389923.432387:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785389923.432593:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.432608:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500030a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389923.432613:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.432624:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389923.432633:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389923.432639:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389923.432753:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.432760:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389923.432790:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.432798:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5eca81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca88 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.432822:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389923.432824:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389923.432825:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389923.433760:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785389923.433787:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879212288:0@lo:103: 00000100:00100000:2.0:1785389923.433870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389923.433940:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212288 00000100:00100000:2.0:1785389923.433949:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212288 00010000:00010000:2.0:1785389923.433982:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 13 pid: 5795 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389923.434030:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785389923.434040:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3309:x1872116879212288:12345-0@lo:103: 00010000:00010000:2.0:1785389923.434057:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785389923.434063:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 13 pid: 5795 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434075:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 13 pid: 5795 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434092:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5eca88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eca81 expref: 13 pid: 5795 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434109:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434118:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434136:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434143:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434151:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434157:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434172:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500031000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785389923.434176:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434184:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434201:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.434210:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785389923.434243:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3309:x1872116879212288:12345-0@lo:103: Request processed in 204us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.434250:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1785389923.434295:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879212288:0@lo:103: 00010000:00010000:0.0:1785389923.435666:0:5795:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.435681:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.435699:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf500031000/0x33dffe75ff5ecb37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1785389923.435717:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1785389923.543252:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:7489:x1872116879211008:12345-0@lo:253: Request processed in 158922us (159455us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.543270:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785389923.543323:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879211008:0@lo:253: 10000000:01000000:1.0:1785389923.543343:0:7489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1785389923.543347:0:7489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785389923.543349:0:7489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785389923.543351:0:7489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785389923.543352:0:7489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1785389923.543354:0:7489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785389923.543355:0:7489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785389923.543357:0:7489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785389923.543377:0:7489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1785389923.543379:0:7489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785389923.543381:0:7489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785389923.543406:0:7489:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf53b946000 from lustre-OST0001 10000000:01000000:1.0:1785389923.543439:0:7489:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1785389923.543443:0:7489:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1785389923.543453:0:7489:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf50ddfb380 local copy 10000000:01000000:1.0:1785389923.543457:0:7489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785389923.543503:0:7489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.543517:0:7489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.543561:0:7489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389923.543582:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212416:0@lo:101: 00000100:00100000:1.0:1785389923.543622:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389923.543678:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15240 going to sleep for 11 seconds 00000100:00100000:2.0:1785389923.543752:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212416 00000100:00100000:2.0:1785389923.543759:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212416 00000100:00100000:2.0:1785389923.543806:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1785389923.543815:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+11:7489:x1872116879212416:12345-0@lo:101: 00010000:00010000:2.0:1785389923.543830:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389923.543845:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecb45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecb3e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.543871:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb3e expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.543883:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb3e expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389923.543905:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529a00, rc 0) 00000100:00100000:2.0:1785389923.543940:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879212416:12345-0@lo:101: Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.543946:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785389923.544069:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212416:0@lo:101: 00010000:00010000:0.0:1785389923.544083:0:7489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.544105:0:7489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.544214:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212544:0@lo:501: 00000100:00100000:0.0:1785389923.544242:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.544271:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785389923.544351:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212544 00000100:00100000:1.0:1785389923.544356:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212544 00000100:00100000:1.0:1785389923.544384:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785389923.544391:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879212544:12345-0@lo:501: 00000100:00100000:1.0:1785389923.544663:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879212544:12345-0@lo:501: Request processed in 271us (419us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785389923.544670:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1785389923.544791:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212544:0@lo:501: 10000000:01000000:0.0:1785389923.544809:0:7489:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1785389923.544833:0:7489:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1785389923.544839:0:7489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.544847:0:7489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.544855:0:7489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.544876:0:7489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1785389923.544902:0:7489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf53b946000 10000000:01000000:0.0:1785389923.544908:0:7489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1785389923.544913:0:7489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1785389923.544915:0:7489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785389923.544920:0:7489:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1785389923.544923:0:7489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1785389923.544939:0:7489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.544957:0:7489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.544966:0:7489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.544979:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212672:0@lo:101: 00000100:00100000:0.0:1785389923.545004:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.545028:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5358593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389923.545090:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212672 00000100:00100000:3.0:1785389923.545100:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212672 00010000:00010000:1.0:1785389923.545184:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785389923.545192:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.545211:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389923.545215:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.545225:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389923.545232:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389923.545238:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1785389923.545257:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.545264:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1785389923.545312:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879212800:0@lo:103: 00000100:00100000:2.0:1785389923.545343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785389923.545383:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.545391:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ecb3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x33dffe75ff5ecb45 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.545403:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389923.545405:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389923.545407:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389923.545418:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212800 00000100:00100000:1.0:1785389923.545421:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212800 00000100:00100000:1.0:1785389923.545452:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785389923.545459:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3307:x1872116879212800:12345-0@lo:103: 00010000:00010000:1.0:1785389923.545468:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785389923.545487:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecb45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecb3e expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.545500:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389923.545565:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785389923.545572:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879212672:12345-0@lo:101: 00010000:00010000:3.0:1785389923.545581:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389923.545591:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecb4c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.545605:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.545614:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.545621:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5e00, rc 0) 00000100:00100000:3.0:1785389923.545650:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879212672:12345-0@lo:101: Request processed in 79us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.545655:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1785389923.550113:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:3307:x1872116879212800:12345-0@lo:103: Request processed in 4640us (4755us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.550129:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785389923.552052:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212672:0@lo:101: 00010000:00010000:0.0:1785389923.552083:0:7489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.552096:0:7489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.552254:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212928:0@lo:501: 00000100:00100000:0.0:1785389923.552332:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.552377:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5358593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389923.552700:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879212928 00000100:00100000:3.0:1785389923.552709:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879212928 00000100:00100000:3.0:1785389923.552753:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785389923.552763:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879212928:12345-0@lo:501: 00000100:00100000:3.0:1785389923.554653:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879212928:12345-0@lo:501: Request processed in 1884us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.554664:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785389923.555919:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879212800:0@lo:103: 00000100:00100000:0.0:1785389923.562063:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879212928:0@lo:501: 00000100:00100000:3.0:1785389923.562208:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213056:0@lo:503: 00000100:00100000:3.0:1785389923.562312:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389923.562360:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257000 going to sleep for 11 seconds 00000100:00100000:0.0:1785389923.562372:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213056 00000100:00100000:0.0:1785389923.562379:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213056 00000100:00100000:0.0:1785389923.562459:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1785389923.562590:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213056:12345-0@lo:503: 00000100:00100000:0.0:1785389923.562836:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213056:12345-0@lo:503: Request processed in 366us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.562855:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785389923.562872:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213056:0@lo:503: 00000040:00080000:3.0:1785389923.563515:0:7489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1785389923.563675:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213184:0@lo:502: 00000100:00100000:3.0:1785389923.563729:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389923.564091:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257000 going to sleep for 11 seconds 00000100:00100000:1.0:1785389923.568166:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213184 00000100:00100000:1.0:1785389923.568182:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213184 00000100:00100000:0.0:1785389923.568603:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1785389923.568615:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213184:12345-0@lo:502: 00000100:00100000:0.0:1785389923.570118:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213184:12345-0@lo:502: Request processed in 1499us (6383us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.570130:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1785389923.570162:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213184:0@lo:502: 00000040:00080000:3.0:1785389923.570551:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1785389923.570612:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1785389923.570639:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1785389923.570677:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1785389923.570734:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1785389923.570760:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1785389923.570802:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213312:0@lo:502: 00000100:00100000:3.0:1785389923.570848:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389923.570879:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257000 going to sleep for 11 seconds 00000100:00100000:0.0:1785389923.571578:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213312 00000100:00100000:0.0:1785389923.571586:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213312 00000100:00100000:0.0:1785389923.571647:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1785389923.571655:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213312:12345-0@lo:502: 00000100:00100000:0.0:1785389923.572558:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213312:12345-0@lo:502: Request processed in 900us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.572566:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1785389923.580090:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213312:0@lo:502: 00000040:00080000:0.0:1785389923.580491:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1785389923.580511:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1785389923.582767:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1785389923.582779:0:7497:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1785389923.582787:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389923.582789:0:7497:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1785389923.582796:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785389923.582837:0:7497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cf53fea4d40) 00000020:00000080:2.0:1785389923.582864:0:7497:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1785389923.582870:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785389923.582951:0:7497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf53b946000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1785389923.582959:0:7497:0:(osd_handler.c:1572:osd_obd_connect()) connect #1 00000020:00000080:2.0:1785389923.582967:0:7497:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33dffe75ff5ecb61 00010000:00010000:3.0:1785389923.594516:0:7497:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1785389923.595626:0:7497:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1785389923.600487:0:7497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1785389923.600964:0:7497:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1785389923.609428:0:7497:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1785389923.609986:0:7497:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1785389923.613183:0:7497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1785389923.613198:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785389923.613206:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389923.613209:0:7497:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1785389923.613216:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785389923.613220:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389923.613222:0:7497:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785389923.613225:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785389923.613227:0:7497:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785389923.613290:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785389923.613293:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389923.613294:0:7497:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1785389923.613298:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1785389923.614970:0:7489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1785389923.615067:0:7489:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1785389923.615093:0:7489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.615107:0:7489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389923.615126:0:7489:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf53b946000 from 1 10000000:01000000:3.0:1785389923.615128:0:7489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785389923.615171:0:7489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.615179:0:7489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.615192:0:7489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389923.615221:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213440:0@lo:101: 00000100:00100000:3.0:1785389923.615303:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389923.615347:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257600 going to sleep for 11 seconds 00000100:00100000:0.0:1785389923.617758:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213440 00000100:00100000:0.0:1785389923.617786:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213440 00000100:00100000:0.0:1785389923.617850:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785389923.617859:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:7489:x1872116879213440:12345-0@lo:101: 00010000:00010000:0.0:1785389923.617888:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389923.617905:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecb68 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.617936:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.617947:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.617956:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf500031400, rc 0) 00000100:00100000:0.0:1785389923.618449:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213440:12345-0@lo:101: Request processed in 589us (3144us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.618457:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785389923.618545:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213440:0@lo:101: 00010000:00010000:0.0:1785389923.618566:0:7489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.618577:0:7489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.618724:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213568:0@lo:501: 00000100:00100000:0.0:1785389923.618759:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.618799:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213568 00000100:00100000:0.0:1785389923.618803:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213568 00000100:00100000:0.0:1785389923.618824:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785389923.618837:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213568:12345-0@lo:501: 00000100:00100000:0.0:1785389923.620646:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213568:12345-0@lo:501: Request processed in 1804us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.620656:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785389923.620787:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859b40 going to sleep for 11 seconds 00000100:00100000:0.0:1785389923.620808:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213568:0@lo:501: 00000100:00100000:0.0:1785389923.620852:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213696:0@lo:503: 00000100:00100000:0.0:1785389923.620906:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.620928:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785389923.621243:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213696 00000100:00100000:2.0:1785389923.621249:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213696 00000100:00100000:2.0:1785389923.621302:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1785389923.621310:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213696:12345-0@lo:503: 00000100:00100000:2.0:1785389923.621677:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213696:12345-0@lo:503: Request processed in 367us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.621695:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785389923.622581:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213696:0@lo:503: 00000040:00080000:0.0:1785389923.623263:0:7489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785389923.623368:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213824:0@lo:502: 00000100:00100000:0.0:1785389923.624506:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.624605:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785389923.624659:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213824 00000100:00100000:1.0:1785389923.624667:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213824 00000100:00100000:1.0:1785389923.624723:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785389923.624733:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213824:12345-0@lo:502: 00000100:00100000:1.0:1785389923.625103:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213824:12345-0@lo:502: Request processed in 370us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.625111:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1785389923.625520:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213824:0@lo:502: 00000040:00080000:0.0:1785389923.625861:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1785389923.626604:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1785389923.626644:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213952:0@lo:502: 00000100:00100000:0.0:1785389923.626704:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.627096:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785389923.636231:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879213952 00000100:00100000:1.0:1785389923.636249:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879213952 00000100:00100000:1.0:1785389923.636318:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785389923.636331:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213952:12345-0@lo:502: 00000100:00100000:1.0:1785389923.636822:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879213952:12345-0@lo:502: Request processed in 493us (10116us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.636832:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1785389923.636975:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879213952:0@lo:502: 00000040:00080000:0.0:1785389923.637184:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1785389923.637201:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1785389923.638220:0:7501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785389923.638232:0:7501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785389923.638234:0:7501:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1785389923.638242:0:7501:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf53b946000 00000020:00000080:1.0:1785389923.638245:0:7501:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1785389923.638262:0:7501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785389923.638274:0:7501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785389923.638276:0:7501:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1785389923.638279:0:7501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1785389923.642213:0:7489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1785389923.642260:0:7489:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785389923.642332:0:7489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.642349:0:7489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389923.643492:0:7489:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1785389923.643498:0:7489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf53b946000 10000000:01000000:0.0:1785389923.643502:0:7489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf53b946000 10000000:01000000:0.0:1785389923.643509:0:7489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785389923.643516:0:7489:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf53b946000 from 1 10000000:01000000:0.0:1785389923.643519:0:7489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785389923.643575:0:7489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.643586:0:7489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.643598:0:7489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.643624:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214080:0@lo:101: 00000100:00100000:0.0:1785389923.643715:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.643762:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859240 going to sleep for 11 seconds 00000100:00100000:3.0:1785389923.644498:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214080 00000100:00100000:3.0:1785389923.644508:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214080 00000100:00100000:3.0:1785389923.644580:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1785389923.644590:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879214080:12345-0@lo:101: 00010000:00010000:3.0:1785389923.644606:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389923.644620:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecb76 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.644645:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.644655:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.644663:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785389923.644735:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214080:12345-0@lo:101: Request processed in 147us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.644742:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785389923.644939:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214080:0@lo:101: 00010000:00010000:0.0:1785389923.644957:0:7489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.644967:0:7489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.645149:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214208:0@lo:501: 00000100:00100000:0.0:1785389923.645177:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.645208:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859240 going to sleep for 11 seconds 00000100:00100000:3.0:1785389923.645249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214208 00000100:00100000:3.0:1785389923.645252:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214208 00000100:00100000:3.0:1785389923.645305:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1785389923.645312:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214208:12345-0@lo:501: 00000100:00100000:3.0:1785389923.645597:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214208:12345-0@lo:501: Request processed in 285us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.645604:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1785389923.649336:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214208:0@lo:501: 00000100:00100000:0.0:1785389923.649977:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214336:0@lo:503: 00000100:00100000:0.0:1785389923.650662:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.650719:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859240 going to sleep for 11 seconds 00000100:00100000:2.0:1785389923.651411:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214336 00000100:00100000:2.0:1785389923.651420:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214336 00000100:00100000:2.0:1785389923.651489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1785389923.651500:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214336:12345-0@lo:503: 00000100:00100000:2.0:1785389923.651766:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214336:12345-0@lo:503: Request processed in 267us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.651774:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1785389923.651787:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214336:0@lo:503: 00000040:00080000:0.0:1785389923.652222:0:7489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785389923.652291:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214464:0@lo:502: 00000100:00100000:0.0:1785389923.652331:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.652363:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859240 going to sleep for 11 seconds 00000100:00100000:3.0:1785389923.652507:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214464 00000100:00100000:3.0:1785389923.652512:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214464 00000100:00100000:3.0:1785389923.652964:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1785389923.652973:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214464:12345-0@lo:502: 00000100:00100000:3.0:1785389923.653244:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214464:12345-0@lo:502: Request processed in 272us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.653251:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1785389923.655931:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214464:0@lo:502: 00000040:00080000:2.0:1785389923.656325:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1785389923.656389:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1785389923.656422:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1785389923.656481:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1785389923.656539:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1785389923.656591:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1785389923.656627:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1785389923.656677:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1785389923.656746:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1785389923.656774:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1785389923.656815:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1785389923.656872:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1785389923.656907:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1785389923.656945:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1785389923.656999:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1785389923.657033:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1785389923.657067:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1785389923.657127:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1785389923.657173:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1785389923.657213:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1785389923.657265:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1785389923.657308:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1785389923.657349:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1785389923.657397:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1785389923.657433:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1785389923.657468:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1785389923.657546:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1785389923.657599:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1785389923.657635:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1785389923.657701:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1785389923.657735:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1785389923.657761:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1785389923.657787:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1785389923.657825:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1785389923.657856:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1785389923.657911:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1785389923.657949:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1785389923.658001:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214592:0@lo:502: 00000100:00100000:2.0:1785389923.658093:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389923.658148:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51f0c9840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389923.658228:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214592 00000100:00100000:0.0:1785389923.658237:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214592 00000100:00100000:0.0:1785389923.658299:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1785389923.658310:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214592:12345-0@lo:502: 00000100:00100000:0.0:1785389923.658723:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879214592:12345-0@lo:502: Request processed in 414us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.658732:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785389923.658945:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879214592:0@lo:502: 00000040:00080000:2.0:1785389923.659068:0:7489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1785389923.659080:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1785389923.659801:0:7502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1785389923.659820:0:7502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cf50e2c3380) 00000020:00000080:0.0:1785389923.659844:0:7502:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1785389923.660268:0:7502:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf53b946000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1785389923.660272:0:7502:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf53b946000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1785389923.660275:0:7502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf53b946000 3 00010000:00080000:0.0:1785389923.660311:0:7502:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf53b947800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1785389923.662028:0:7502:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1785389923.662139:0:7502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1785389923.662174:0:7502:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1785389923.662188:0:7502:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x33dffe75ff5ecb8b 00000100:00080000:0.0:1785389923.662199:0:7502:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785389923.662205:0:7502:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf53b947800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1785389923.662247:0:7502:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53a357100 x1872116879214720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785389923.662280:0:7502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1785389923.664978:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872116879214720:0@lo:38: 00000100:00100000:3.0:1785389923.665088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.665486:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214720 00000100:00100000:0.0:1785389923.665496:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214720 00000100:00100000:0.0:1785389923.665647:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785389923.665657:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872116879214720:12345-0@lo:38: 00010000:00080000:0.0:1785389923.665701:0:5804:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1785389923.665753:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x33dffe75ff5ecb92 00000004:00100000:0.0:1785389923.665773:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785389923.665813:0:5804:0:(import.c:65:import_set_state_nolock()) ffff8cf50e183000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785389923.668024:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872116879214720:12345-0@lo:38: Request processed in 2350us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.668036:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785389923.672178:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389923.672206:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879214848:0@lo:400: 00000100:00100000:2.0:1785389923.672287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1785389923.674037:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357100 x1872116879214720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785389933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389923.674054:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1785389923.674067:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1785389923.674079:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1785389923.674085:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1785389923.674090:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf53b947800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1785389923.674097:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872116879214720:0@lo:38: 00000100:00100000:2.0:1785389923.675593:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879214976:0@lo:400: 00000100:00100000:2.0:1785389923.675656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389923.676520:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214848 00000100:00100000:3.0:1785389923.676540:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214848 00000100:00100000:3.0:1785389923.676613:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785389923.676623:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879214848:12345-0@lo:400: 00000100:00100000:3.0:1785389923.676704:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879214848:12345-0@lo:400: Request processed in 82us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.676712:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785389923.677602:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879215104:0@lo:400: 00000100:00100000:3.0:1785389923.677653:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.677749:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215104 00000100:00100000:0.0:1785389923.677755:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215104 00000100:00100000:0.0:1785389923.677849:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785389923.677859:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879215104:12345-0@lo:400: 00000100:00100000:0.0:1785389923.677915:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879215104:12345-0@lo:400: Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389923.677933:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1785389923.677979:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a890700 x1872116879215104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389923.677994:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879215104:0@lo:400: 00000040:00080000:0.0:1785389923.678176:0:7502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1785389923.678352:0:7503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7503:1872116879215232:0@lo:901: 00000100:00100000:0.0:1785389923.679543:0:7503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389923.679579:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215232 00000100:00100000:1.0:1785389923.679587:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215232 00000100:00100000:0.0:1785389923.679599:0:7503:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785389923.679797:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879214976 00000100:00100000:2.0:1785389923.679802:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879214976 00000100:00080000:3.0:1785389923.683359:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785389923.683371:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785389923.684111:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a893b80 x1872116879214848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389923.684130:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879214848:0@lo:400: 00000020:01000000:3.0:1785389923.684539:0:7489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1785389923.684583:0:7489:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785389923.684602:0:7489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.684615:0:7489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785389923.684670:0:7489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785389923.684672:0:7489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785389923.684673:0:7489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785389923.684674:0:7489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785389923.684676:0:7489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785389923.684677:0:7489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785389923.684688:0:7489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785389923.684690:0:7489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785389923.684691:0:7489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785389923.684693:0:7489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785389923.684695:0:7489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785389923.684699:0:7489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1785389923.684702:0:7489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785389923.684703:0:7489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785389923.684704:0:7489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785389923.684705:0:7489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785389923.684706:0:7489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785389923.684707:0:7489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785389923.684709:0:7489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785389923.684710:0:7489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1785389923.684711:0:7489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1785389923.684712:0:7489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785389923.684713:0:7489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785389923.684743:0:7489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1785389923.684763:0:7489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879215360:0@lo:253: 00000100:00100000:3.0:1785389923.684845:0:7489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.685125:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215360 00000100:00100000:0.0:1785389923.685133:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215360 00000100:00100000:0.0:1785389923.685181:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1785389923.685190:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7489:x1872116879215360:12345-0@lo:253: 20000000:01000000:0.0:1785389923.685222:0:5795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1785389923.685239:0:5795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1785389923.685444:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1785389923.685454:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7503:x1872116879215232:12345-0@lo:901: 00000100:00100000:3.0:1785389923.685945:0:7489:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785389923.689552:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7503:x1872116879215232:12345-0@lo:901: Request processed in 4087us (9998us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.689568:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785389923.691186:0:7503:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a357800 x1872116879215232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1785389939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389923.691206:0:7503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7503:1872116879215232:0@lo:901: 00000100:00100000:2.0:1785389923.693890:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785389923.693905:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879214976:12345-0@lo:400: 00000100:00100000:2.0:1785389923.694033:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879214976:12345-0@lo:400: Request processed in 133us (18376us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389923.694041:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1785389923.694105:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53a890e00 x1872116879214976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389923.694119:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879214976:0@lo:400: 20000000:01000000:3.0:1785389923.743606:0:5795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785389923.743666:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1785389923.746316:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1785389923.746327:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1785389923.746354:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.746377:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.746622:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.746703:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389923.746720:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 14 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389923.746738:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1872116879215488:0@lo:104: 00000100:00100000:0.0:1785389923.746818:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389923.746867:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51833ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1785389923.747246:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215488 00000100:00100000:1.0:1785389923.747256:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215488 00000100:00100000:1.0:1785389923.747341:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785389923.747350:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5818:x1872116879215488:12345-0@lo:104: 00010000:00010000:1.0:1785389923.747364:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.747437:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785389923.747443:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:5818:x1872116879215488:12345-0@lo:104: Request processed in 94us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389923.747461:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1785389923.747496:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785389923.747502:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.747511:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4800 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389923.747515:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.747542:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389923.747551:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389923.747558:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1785389923.747595:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.747616:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785389923.747636:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.747642:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4800/0x33dffe75ff5ecae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaea expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.747658:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389923.747660:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389923.747661:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389923.747710:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879215616:0@lo:103: 00000100:00100000:1.0:1785389923.747757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389923.747829:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1872116879215488:0@lo:104: 00010000:00010000:1.0:1785389923.747853:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389923.751040:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215616 00000100:00100000:3.0:1785389923.751055:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215616 00010000:00010000:3.0:1785389923.751095:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 15 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389923.751209:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785389923.751220:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:3307:x1872116879215616:12345-0@lo:103: 00010000:00010000:3.0:1785389923.751234:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389923.751241:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 15 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751253:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 15 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751273:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecaea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecae3 expref: 15 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751292:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751301:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785389923.751340:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005014691s 00010000:00010000:3.0:1785389923.751346:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751353:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751359:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751366:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751371:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500030600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785389923.751375:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751382:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751506:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389923.751517:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785389923.751573:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.751581:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389923.751586:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf500030600/0x33dffe75ff5ecb99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389923.751612:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e21ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:3307:x1872116879215616:12345-0@lo:103: Request processed in 394us (3863us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.751619:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785389923.751630:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879215616:0@lo:103: 00000100:00100000:3.0:1785389923.785106:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:7489:x1872116879215360:12345-0@lo:253: Request processed in 99904us (100249us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389923.785125:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1785389923.785270:0:7489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:19ebcf8f-53c9-4fee-a69e-b0198873419f:7489:1872116879215360:0@lo:253: 10000000:01000000:2.0:1785389923.785288:0:7489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1785389923.785293:0:7489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1785389923.785295:0:7489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1785389923.785296:0:7489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1785389923.785297:0:7489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1785389923.785298:0:7489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1785389923.785300:0:7489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1785389923.785302:0:7489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1785389923.785303:0:7489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1785389923.785305:0:7489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1785389923.785306:0:7489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1785389923.785308:0:7489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1785389923.785325:0:7489:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1785389923.794217:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1785389923.795011:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1785389923.795235:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1785389923.796018:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1785389923.796248:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1785389923.797179:0:7489:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00010000:00010000:3.0:1785389923.800077:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1785389923.801808:0:7489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1785389924.194007:0:7489:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1785389924.194019:0:7489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1785389924.194067:0:7489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1785389924.194146:0:7489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1785389924.194162:0:7489:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1785389924.194199:0:7489:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1785389924.822619:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389925.845726:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389926.869752:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389927.446817:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879215744:0@lo:13: 00000100:00100000:3.0:1785389927.446908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389927.448596:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215744 00000100:00100000:1.0:1785389927.448609:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215744 00000100:00100000:1.0:1785389927.448682:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785389927.448693:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879215744:12345-0@lo:13: 00002000:00000024:1.0:1785389927.448736:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389927.448799:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879215744:12345-0@lo:13: Request processed in 108us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389927.448814:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1785389927.449167:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785389927.449205:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535fbd180 x1872116879215744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389927.449227:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879215744:0@lo:13: 00010000:00010000:3.0:1785389927.893792:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389928.919773:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389928.982326:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879216000:0@lo:400: 00000100:00100000:1.0:1785389928.982422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389928.982489:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785389928.982494:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879215872:0@lo:400: 00000100:00100000:1.0:1785389928.982548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389928.982567:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879216384:0@lo:400: 00000100:00100000:1.0:1785389928.982588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389928.982610:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879216128:0@lo:400: 00000100:00100000:1.0:1785389928.982629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389928.982655:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785389928.982660:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879216256:0@lo:400: 00000100:00100000:1.0:1785389928.982683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389928.982716:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216000 00000100:00100000:1.0:1785389928.982725:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216000 00000100:00100000:1.0:1785389928.982772:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216384 00000100:00100000:1.0:1785389928.982776:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216384 00000100:00100000:1.0:1785389928.982801:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216128 00000100:00100000:1.0:1785389928.982804:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216128 00000100:00100000:1.0:1785389928.982821:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785389928.982830:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879216000:12345-0@lo:400: 00000100:00100000:1.0:1785389928.982988:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879216000:12345-0@lo:400: Request processed in 158us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389928.982996:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785389928.983015:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785389928.983021:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879216384:12345-0@lo:400: 00000100:00100000:1.0:1785389928.983057:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879216384:12345-0@lo:400: Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389928.983064:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785389928.983073:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785389928.983078:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879216128:12345-0@lo:400: 00000100:00100000:1.0:1785389928.983102:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879216128:12345-0@lo:400: Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389928.983107:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785389928.983127:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216256 00000100:00100000:1.0:1785389928.983130:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216256 00000100:00100000:1.0:1785389928.983154:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785389928.983159:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879216256:12345-0@lo:400: 00000100:00100000:1.0:1785389928.983184:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879216256:12345-0@lo:400: Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389928.983190:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1785389928.983203:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785389928.983235:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50de81c00 x1872116879216256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389928.983251:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879216256:0@lo:400: 00010000:00080000:1.0:1785389928.983261:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50de80000 x1872116879216128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389928.983269:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879216128:0@lo:400: 00010000:00080000:1.0:1785389928.983301:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac0380 x1872116879216384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389928.983309:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879216384:0@lo:400: 00010000:00080000:1.0:1785389928.983324:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50de83b80 x1872116879216000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389928.983332:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879216000:0@lo:400: 00000100:00100000:3.0:1785389928.983706:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879215872 00000100:00100000:3.0:1785389928.983710:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879215872 00000100:00100000:3.0:1785389928.983746:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1785389928.983754:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3310:x1872116879215872:12345-0@lo:400: 00000100:00100000:3.0:1785389928.983804:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:3310:x1872116879215872:12345-0@lo:400: Request processed in 51us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389928.983811:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785389928.984029:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879215872:0@lo:400: 00010000:00010000:3.0:1785389929.944690:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389930.971723:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785389931.542072:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785389931.542080:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf5111bb800 from 30 10000000:01000000:0.0:1785389931.542086:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785389931.542150:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389931.542162:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389931.542172:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389931.542199:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879216512:0@lo:101: 00000100:00100000:0.0:1785389931.542282:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389931.542347:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039df00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.542900:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216512 00000100:00100000:3.0:1785389931.542910:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216512 00000100:00100000:3.0:1785389931.542981:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1785389931.542991:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879216512:12345-0@lo:101: 00010000:00010000:3.0:1785389931.543007:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389931.543029:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecba0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.543055:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.543065:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.543075:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5200, rc 0) 00000100:00100000:3.0:1785389931.543116:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879216512:12345-0@lo:101: Request processed in 126us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.543122:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1785389931.543279:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879216512:0@lo:101: 00010000:00010000:2.0:1785389931.543297:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.543306:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389931.543379:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879216640:0@lo:501: 00000100:00100000:2.0:1785389931.543414:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.543444:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785389931.543546:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216640 00000100:00100000:0.0:1785389931.543556:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216640 00000100:00100000:0.0:1785389931.543580:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1785389931.543585:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879216640:12345-0@lo:501: 00000100:00100000:0.0:1785389931.543997:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879216640:12345-0@lo:501: Request processed in 412us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389931.544005:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785389931.544565:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879216640:0@lo:501: 00000100:00100000:2.0:1785389931.544598:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879216768:0@lo:503: 00000100:00100000:2.0:1785389931.544649:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.544670:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785389931.544725:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216768 00000100:00100000:0.0:1785389931.544730:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216768 00000100:00100000:0.0:1785389931.544760:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785389931.544767:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879216768:12345-0@lo:503: 00000100:00100000:0.0:1785389931.545056:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879216768:12345-0@lo:503: Request processed in 288us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389931.545062:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1785389931.545095:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879216768:0@lo:503: 00000100:00100000:3.0:1785389931.561946:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7749:1872116879216896:0@lo:502: 00000100:00100000:3.0:1785389931.562055:0:7749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.562101:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879216896 00000100:00100000:3.0:1785389931.562108:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879216896 00000100:00100000:3.0:1785389931.562159:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785389931.562167:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7749:x1872116879216896:12345-0@lo:502: 00000100:00100000:3.0:1785389931.562515:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7749:x1872116879216896:12345-0@lo:502: Request processed in 347us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.562540:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1785389931.562590:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.562625:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7749:1872116879216896:0@lo:502: 00000100:00100000:3.0:1785389931.562671:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7749:1872116879217024:0@lo:502: 00000100:00100000:3.0:1785389931.562698:0:7749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.562713:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.562742:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217024 00000100:00100000:3.0:1785389931.562751:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217024 00000100:00100000:3.0:1785389931.562770:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785389931.562774:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7749:x1872116879217024:12345-0@lo:502: 00000100:00100000:3.0:1785389931.562889:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:7749:x1872116879217024:12345-0@lo:502: Request processed in 112us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.562896:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1785389931.562930:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7749:1872116879217024:0@lo:502: 00000040:00080000:3.0:1785389931.562945:0:7749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1785389931.562999:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1785389931.563019:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785389931.563030:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563041:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389931.563051:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1785389931.563053:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1785389931.563056:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1785389931.563085:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563092:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563102:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389931.563111:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217152:0@lo:101: 00000100:00100000:3.0:1785389931.563141:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.563152:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.563161:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217152 00000100:00100000:3.0:1785389931.563164:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217152 00000100:00100000:3.0:1785389931.563179:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1785389931.563184:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879217152:12345-0@lo:101: 00010000:00010000:3.0:1785389931.563192:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389931.563203:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecbae expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563224:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563234:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563242:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785389931.563265:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879217152:12345-0@lo:101: Request processed in 80us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.563270:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1785389931.563296:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217152:0@lo:101: 00010000:00010000:3.0:1785389931.563307:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.563316:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389931.563349:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217280:0@lo:501: 00000100:00100000:3.0:1785389931.563380:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.563391:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.563401:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217280 00000100:00100000:3.0:1785389931.563404:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217280 00000100:00100000:3.0:1785389931.563420:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1785389931.563426:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879217280:12345-0@lo:501: 00000100:00100000:3.0:1785389931.563651:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879217280:12345-0@lo:501: Request processed in 224us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.563657:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1785389931.563680:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217280:0@lo:501: 00000100:00100000:3.0:1785389931.563712:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217408:0@lo:503: 00000100:00100000:3.0:1785389931.563741:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.563757:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.563765:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217408 00000100:00100000:3.0:1785389931.563768:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217408 00000100:00100000:3.0:1785389931.563782:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1785389931.563786:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879217408:12345-0@lo:503: 00000100:00100000:3.0:1785389931.564031:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879217408:12345-0@lo:503: Request processed in 244us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.564037:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1785389931.564066:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217408:0@lo:503: 00000100:00100000:3.0:1785389931.564287:0:7752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7752:1872116879217536:0@lo:502: 00000100:00100000:3.0:1785389931.564319:0:7752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.564335:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217536 00000100:00100000:3.0:1785389931.564338:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217536 00000100:00100000:3.0:1785389931.564354:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1785389931.564364:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:7752:x1872116879217536:12345-0@lo:502: 00000100:00100000:1.0:1785389931.567392:0:7752:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.572796:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:7752:x1872116879217536:12345-0@lo:502: Request processed in 8420us (8464us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.572811:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1785389931.572904:0:7752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7752:1872116879217536:0@lo:502: 00000020:01000000:3.0:1785389931.572944:0:7752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785389931.572954:0:7752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389931.572957:0:7752:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1785389931.572964:0:7752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1785389931.572966:0:7752:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1785389931.573003:0:7752:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7752:1872116879217664:0@lo:502: 00000100:00100000:3.0:1785389931.573048:0:7752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.573078:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217664 00000100:00100000:3.0:1785389931.573085:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217664 00000100:00100000:3.0:1785389931.573121:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1785389931.573129:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:7752:x1872116879217664:12345-0@lo:502: 00000100:00100000:3.0:1785389931.573324:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:7752:x1872116879217664:12345-0@lo:502: Request processed in 194us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.573332:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1785389931.573371:0:7752:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.573382:0:7752:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7752:1872116879217664:0@lo:502: 00000020:01000000:3.0:1785389931.573398:0:7752:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389931.573403:0:7752:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389931.573404:0:7752:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1785389931.573409:0:7752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1785389931.573484:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1785389931.573500:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785389931.573512:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573557:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389931.573570:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785389931.573572:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf509225000 from 30 10000000:01000000:3.0:1785389931.573575:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785389931.573601:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573619:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573630:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389931.573641:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217792:0@lo:101: 00000100:00100000:3.0:1785389931.573665:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.573682:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.573693:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217792 00000100:00100000:3.0:1785389931.573696:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217792 00000100:00100000:3.0:1785389931.573715:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1785389931.573720:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879217792:12345-0@lo:101: 00010000:00010000:3.0:1785389931.573728:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389931.573741:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecbbc expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573763:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573785:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573795:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4400, rc 0) 00000100:00100000:3.0:1785389931.573820:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879217792:12345-0@lo:101: Request processed in 100us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.573825:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1785389931.573852:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217792:0@lo:101: 00010000:00010000:3.0:1785389931.573864:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.573873:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389931.573911:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217920:0@lo:501: 00000100:00100000:3.0:1785389931.573933:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.573942:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.573952:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879217920 00000100:00100000:3.0:1785389931.573954:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879217920 00000100:00100000:3.0:1785389931.573971:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785389931.573976:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879217920:12345-0@lo:501: 00000100:00100000:3.0:1785389931.574185:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879217920:12345-0@lo:501: Request processed in 207us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.574190:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785389931.574215:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879217920:0@lo:501: 00000100:00100000:3.0:1785389931.574240:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218048:0@lo:503: 00000100:00100000:3.0:1785389931.574274:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.574286:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.574296:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218048 00000100:00100000:3.0:1785389931.574298:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218048 00000100:00100000:3.0:1785389931.574318:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785389931.574323:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879218048:12345-0@lo:503: 00000100:00100000:3.0:1785389931.574439:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879218048:12345-0@lo:503: Request processed in 115us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.574445:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785389931.574474:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218048:0@lo:503: 00000100:00100000:2.0:1785389931.576785:0:7754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7754:1872116879218176:0@lo:502: 00000100:00100000:2.0:1785389931.576849:0:7754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.576884:0:7754:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd840 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.576926:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218176 00000100:00100000:3.0:1785389931.576932:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218176 00000100:00100000:3.0:1785389931.576997:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1785389931.577006:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:7754:x1872116879218176:12345-0@lo:502: 00000100:00100000:3.0:1785389931.577199:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:7754:x1872116879218176:12345-0@lo:502: Request processed in 194us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.577206:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1785389931.588359:0:7754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7754:1872116879218176:0@lo:502: 00000100:00100000:2.0:1785389931.588494:0:7754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7754:1872116879218304:0@lo:502: 00000100:00100000:2.0:1785389931.588606:0:7754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.588655:0:7754:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389931.588786:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218304 00000100:00100000:0.0:1785389931.588794:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218304 00000100:00100000:0.0:1785389931.588853:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1785389931.588864:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:7754:x1872116879218304:12345-0@lo:502: 00000100:00100000:0.0:1785389931.589136:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:7754:x1872116879218304:12345-0@lo:502: Request processed in 273us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389931.589143:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785389931.589456:0:7754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7754:1872116879218304:0@lo:502: 00000040:00080000:2.0:1785389931.589489:0:7754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1785389931.589759:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1785389931.589780:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785389931.589790:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389931.589802:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389931.589823:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1785389931.589826:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf509225000 from 5 10000000:01000000:0.0:1785389931.589829:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1785389931.589878:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389931.589886:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389931.589896:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389931.589910:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218432:0@lo:101: 00000100:00100000:0.0:1785389931.589940:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389931.589963:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d540 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.590073:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218432 00000100:00100000:2.0:1785389931.590078:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218432 00000100:00100000:2.0:1785389931.590103:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1785389931.590109:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879218432:12345-0@lo:101: 00010000:00010000:2.0:1785389931.590117:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389931.590132:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501528600/0x33dffe75ff5ecbd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecbca expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.590153:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501528600/0x33dffe75ff5ecbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbca expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.590173:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501528600/0x33dffe75ff5ecbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbca expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.590184:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501528600, rc 0) 00000100:00100000:2.0:1785389931.590209:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879218432:12345-0@lo:101: Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.590215:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1785389931.590273:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218432:0@lo:101: 00010000:00010000:0.0:1785389931.590285:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389931.590296:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389931.590341:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218560:0@lo:256: 00000100:00100000:0.0:1785389931.590372:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389931.590391:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d540 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.590673:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218560 00000100:00100000:2.0:1785389931.590676:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218560 00000100:00100000:2.0:1785389931.590700:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1785389931.590705:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879218560:12345-0@lo:256: 20000000:01000000:2.0:1785389931.590719:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1785389931.590738:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1785389931.590741:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1785389931.590823:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879218560:12345-0@lo:256: Request processed in 116us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.590830:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1785389931.590852:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218560:0@lo:256: 10000000:01000000:2.0:1785389931.590894:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785389931.590900:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.590907:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389931.590914:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1785389931.590916:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1785389931.590923:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785389931.590962:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.590968:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.590975:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389931.590983:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218688:0@lo:101: 00000100:00100000:2.0:1785389931.591006:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.591013:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.591027:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218688 00000100:00100000:2.0:1785389931.591030:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218688 00000100:00100000:2.0:1785389931.591044:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1785389931.591049:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879218688:12345-0@lo:101: 00010000:00010000:2.0:1785389931.591055:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389931.591063:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecbd8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.591075:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.591083:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.591088:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501528400, rc 0) 00000100:00100000:2.0:1785389931.591109:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879218688:12345-0@lo:101: Request processed in 60us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.591122:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1785389931.591140:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218688:0@lo:101: 00010000:00010000:2.0:1785389931.591148:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.591156:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389931.591201:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218816:0@lo:501: 00000100:00100000:2.0:1785389931.591222:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.591229:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.591241:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218816 00000100:00100000:2.0:1785389931.591244:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218816 00000100:00100000:2.0:1785389931.591260:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1785389931.591266:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879218816:12345-0@lo:501: 00000100:00100000:2.0:1785389931.592889:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879218816:12345-0@lo:501: Request processed in 1617us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.592900:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1785389931.592932:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218816:0@lo:501: 00000100:00100000:2.0:1785389931.592969:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218944:0@lo:503: 00000100:00100000:2.0:1785389931.593009:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.593019:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.593037:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879218944 00000100:00100000:2.0:1785389931.593042:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879218944 00000100:00100000:2.0:1785389931.593060:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1785389931.593065:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879218944:12345-0@lo:503: 00000100:00100000:2.0:1785389931.593370:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879218944:12345-0@lo:503: Request processed in 303us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.593377:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1785389931.593406:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879218944:0@lo:503: 00000100:00100000:3.0:1785389931.597377:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7755:1872116879219072:0@lo:502: 00000100:00100000:3.0:1785389931.597486:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.597540:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.598262:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219072 00000100:00100000:2.0:1785389931.598271:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219072 00000100:00100000:2.0:1785389931.598319:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1785389931.598327:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:7755:x1872116879219072:12345-0@lo:502: 00000100:00100000:2.0:1785389931.598701:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:7755:x1872116879219072:12345-0@lo:502: Request processed in 373us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.598708:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785389931.598829:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7755:1872116879219072:0@lo:502: 00000020:01000000:3.0:1785389931.598863:0:7755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1785389931.598872:0:7755:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1785389931.598880:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389931.598882:0:7755:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1785389931.598889:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1785389931.598898:0:7755:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:3.0:1785389931.598925:0:7755:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1785389931.598928:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1785389931.598947:0:7755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cf53f424d40) 00000020:00000080:3.0:1785389931.598971:0:7755:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1785389931.598975:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1785389931.599061:0:7755:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1785389931.599067:0:7755:0:(osd_handler.c:1572:osd_obd_connect()) connect #6 00000020:00000080:3.0:1785389931.599073:0:7755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5ecbed 00010000:00080000:3.0:1785389931.599103:0:7755:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf506043000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1785389931.599338:0:7755:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1785389931.599689:0:7755:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1785389931.599700:0:7755:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1785389931.600201:0:7755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785389931.600393:0:7755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785389931.600452:0:7755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1785389931.600995:0:7755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1785389931.603095:0:7756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785389931.603102:0:7756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1785389931.604414:0:7755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785389931.604435:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785389931.604472:0:7755:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1785389931.604499:0:7755:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5ecbf4 00000100:00080000:0.0:1785389931.604512:0:7755:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785389931.604519:0:7755:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf506043000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1785389931.604598:0:7755:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53a356680 x1872116879219200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785389931.604631:0:7755:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1785389931.604681:0:7755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785389931.604685:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389931.604687:0:7755:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1785389931.604689:0:7755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785389931.604694:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389931.604695:0:7755:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785389931.604698:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785389931.604700:0:7755:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1785389931.604729:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7755:1872116879219328:0@lo:502: 00000100:00100000:0.0:1785389931.604815:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389931.604855:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d900 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.604998:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879219456:0@lo:400: 00000100:00100000:2.0:1785389931.605030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.605055:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785389931.605060:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879219840:0@lo:400: 00000100:00100000:2.0:1785389931.605081:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.605104:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879219712:0@lo:400: 00000100:00100000:2.0:1785389931.605126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.605141:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785389931.605145:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879219584:0@lo:400: 00000100:00100000:2.0:1785389931.605160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.605184:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219456 00000100:00100000:2.0:1785389931.605191:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219456 00000100:00100000:2.0:1785389931.605227:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219840 00000100:00100000:2.0:1785389931.605229:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219840 00000100:00100000:2.0:1785389931.605247:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219584 00000100:00100000:2.0:1785389931.605255:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219584 00000100:00100000:2.0:1785389931.605277:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785389931.605286:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879219456:12345-0@lo:400: 00000100:00100000:2.0:1785389931.605340:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879219456:12345-0@lo:400: Request processed in 55us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.605347:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785389931.605361:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785389931.605366:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879219840:12345-0@lo:400: 00000100:00100000:2.0:1785389931.605390:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879219840:12345-0@lo:400: Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.605396:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785389931.605407:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785389931.605413:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879219584:12345-0@lo:400: 00000100:00100000:2.0:1785389931.605441:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879219584:12345-0@lo:400: Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.605446:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785389931.605465:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219712 00000100:00100000:2.0:1785389931.605468:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219712 00000100:00100000:2.0:1785389931.605497:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785389931.605503:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879219712:12345-0@lo:400: 00000100:00100000:2.0:1785389931.605544:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879219712:12345-0@lo:400: Request processed in 42us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.605550:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1785389931.605570:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785389931.605574:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785389931.605620:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a891500 x1872116879219584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.605644:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879219584:0@lo:400: 00010000:00080000:2.0:1785389931.605656:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a890a80 x1872116879219712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.605663:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879219712:0@lo:400: 00010000:00080000:2.0:1785389931.605688:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a893480 x1872116879219840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.605694:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879219840:0@lo:400: 00010000:00080000:2.0:1785389931.605701:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a893800 x1872116879219456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.605709:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879219456:0@lo:400: 00000100:00100000:2.0:1785389931.605724:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219328 00000100:00100000:2.0:1785389931.605727:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219328 00000100:00100000:2.0:1785389931.605752:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1785389931.605758:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:7755:x1872116879219328:12345-0@lo:502: 00000100:00100000:2.0:1785389931.605988:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:7755:x1872116879219328:12345-0@lo:502: Request processed in 229us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.605994:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1785389931.606035:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:7755:1872116879219328:0@lo:502: 00000020:01000000:2.0:1785389931.606054:0:7755:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389931.606058:0:7755:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389931.606060:0:7755:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1785389931.606064:0:7755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1785389931.606116:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1785389931.606134:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1785389931.606148:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.606160:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389931.606169:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1785389931.606172:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf50ddfb380 from 1 10000000:01000000:2.0:1785389931.606175:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1785389931.606201:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389931.606208:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389931.606536:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879219200:0@lo:8: 00000100:00100000:3.0:1785389931.606574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785389931.606811:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389931.606828:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879219968:0@lo:101: 00000100:00100000:2.0:1785389931.606855:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.606905:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1785389931.607633:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219200 00000100:00100000:0.0:1785389931.607640:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219200 00000100:00100000:0.0:1785389931.607670:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785389931.607677:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1872116879219200:12345-0@lo:8: 00010000:00080000:0.0:1785389931.607704:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1785389931.607733:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5ecc02 00002000:00100000:0.0:1785389931.607749:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cf51f0e5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1785389931.607754:0:6599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1785389931.607758:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1785389931.607928:0:6599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1785389931.608084:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785389931.608109:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785389931.608162:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1872116879219200:12345-0@lo:8: Request processed in 483us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389931.608169:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1785389931.612603:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a356680 x1872116879219200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785389941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.612633:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785389931.612644:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1785389931.612654:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1785389931.612662:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1785389931.612666:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf506043000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1785389931.612682:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1785389931.612696:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879219200:0@lo:8: 00000004:00080000:0.0:1785389931.613238:0:7756:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785389931.613341:0:7756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 240167816406ns, next at 0ns, rc = 0 00000100:00100000:3.0:1785389931.614414:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879219968 00000100:00100000:3.0:1785389931.614423:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879219968 00000100:00100000:3.0:1785389931.614483:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1785389931.614493:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879219968:12345-0@lo:101: 00010000:00010000:3.0:1785389931.614511:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389931.614545:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecbfb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.614575:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.614598:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.614617:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5000, rc 0) 00000100:00100000:3.0:1785389931.614703:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879219968:12345-0@lo:101: Request processed in 212us (7847us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.614710:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1785389931.614766:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879219968:0@lo:101: 00010000:00010000:3.0:1785389931.614786:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.614796:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389931.614873:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879220096:0@lo:501: 00000100:00100000:3.0:1785389931.614910:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.614938:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1785389931.617312:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220096 00000100:00100000:3.0:1785389931.617323:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220096 00000100:00100000:3.0:1785389931.617363:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785389931.617373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879220096:12345-0@lo:501: 00000100:00100000:3.0:1785389931.628374:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879220096:12345-0@lo:501: Request processed in 10993us (13453us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785389931.628392:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785389931.628473:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879220096:0@lo:501: 10000000:01000000:3.0:1785389931.628517:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1785389931.628590:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389931.628601:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785389931.685512:0:7757:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1785389931.685578:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220352:0@lo:7: 00000100:00100000:3.0:1785389931.685656:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.685697:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd180 going to sleep for 11 seconds 00000004:00080000:3.0:1785389931.685716:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1785389931.685958:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879220224:0@lo:13: 00000100:00100000:2.0:1785389931.686020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389931.686085:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220224 00000100:00100000:3.0:1785389931.686096:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220224 00000100:00100000:2.0:1785389931.686100:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220352 00000100:00100000:2.0:1785389931.686109:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220352 00000100:00100000:2.0:1785389931.686172:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785389931.686181:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7757:x1872116879220352:12345-0@lo:7: 00000100:00100000:3.0:1785389931.686264:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785389931.686276:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879220224:12345-0@lo:13: 00002000:00000024:3.0:1785389931.686310:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1785389931.686417:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879220224:12345-0@lo:13: Request processed in 145us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389931.686425:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1785389931.686587:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1785389931.690674:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535fbea00 x1872116879220224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389931.690700:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879220224:0@lo:13: 00002000:00080000:2.0:1785389931.712459:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1785389931.712873:0:6598:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1785389931.715243:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7757:x1872116879220352:12345-0@lo:7: Request processed in 29053us (29579us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.715257:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1785389931.721724:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535fbf100 x1872116879220352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1785389947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389931.721745:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220352:0@lo:7: 00000004:00080000:0.0:1785389931.721763:0:7757:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1785389931.721918:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220480:0@lo:5: 00000100:00100000:2.0:1785389931.722008:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.722067:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785389931.722738:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220480 00000100:00100000:0.0:1785389931.722747:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220480 00000100:00100000:2.0:1785389931.729443:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785389931.729468:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7757:x1872116879220480:12345-0@lo:5: 00002000:00080000:2.0:1785389931.729557:0:6599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1785389931.729562:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1785389931.730094:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7757:x1872116879220480:12345-0@lo:5: Request processed in 636us (8084us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1785389931.730101:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1785389931.730188:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a890a80 x1872116879220480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785389947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.730207:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220480:0@lo:5: 00000004:00080000:2.0:1785389931.730221:0:7757:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1785389931.730274:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220608:0@lo:700: 00000100:00100000:2.0:1785389931.730314:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.730349:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220608 00000100:00100000:2.0:1785389931.730356:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220608 00000100:00100000:2.0:1785389931.730392:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785389931.730399:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7757:x1872116879220608:12345-0@lo:700: 00000100:00100000:2.0:1785389931.730428:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6605:1872116879220736:0@lo:700: 00000100:00100000:2.0:1785389931.730455:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.730488:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803240 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.730544:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220736 00000100:00100000:2.0:1785389931.730547:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220736 00000100:00100000:2.0:1785389931.730572:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785389931.730577:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6605:x1872116879220736:12345-0@lo:700: 00000100:00100000:2.0:1785389931.731160:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803a80 going to sleep for 11 seconds 40000000:02000000:2.0:1785389931.778275:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1785389931.791834:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6605:x1872116879220736:12345-0@lo:700: Request processed in 61244us (61366us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.791851:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785389931.791910:0:6605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a890700 x1872116879220736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1785389947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389931.791929:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6605:1872116879220736:0@lo:700: 40000000:02000000:3.0:1785389931.791946:0:6605:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1785389931.954336:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7757:x1872116879220608:12345-0@lo:700: Request processed in 223923us (224008us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389931.954354:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1785389931.954396:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1785389931.954419:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1785389931.954539:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a891180 x1872116879220608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1785389947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389931.954556:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220608:0@lo:700: 00000004:02000040:2.0:1785389931.988786:0:7757:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1785389931.992639:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220864:0@lo:5: 00000100:00100000:2.0:1785389931.992720:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389931.992779:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803540 going to sleep for 11 seconds 00000100:00100000:2.0:1785389931.992852:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220864 00000100:00100000:2.0:1785389931.992860:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220864 00000100:00100000:2.0:1785389931.992915:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785389931.992924:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7757:x1872116879220864:12345-0@lo:5: 00010000:00010000:3.0:1785389931.997592:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1785389932.012773:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1785389932.013295:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1785389932.023866:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7757:x1872116879220864:12345-0@lo:5: Request processed in 30934us (31136us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1785389932.023881:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1785389932.024964:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a891180 x1872116879220864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785389947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389932.024979:0:7757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1785389932.024999:0:7757:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf53a891180 x1872116879220864/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1785389947 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389932.025010:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1872116879220864:0@lo:5: 00000004:00080000:2.0:1785389932.025035:0:7757:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1785389932.573190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785389932.573221:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879220992:0@lo:13: 00000100:00100000:0.0:1785389932.573305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389932.573383:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879220992 00000100:00100000:0.0:1785389932.573392:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879220992 00000100:00100000:0.0:1785389932.573447:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785389932.573457:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879220992:12345-0@lo:13: 00002000:00000024:0.0:1785389932.573504:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389932.573575:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879220992:12345-0@lo:13: Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389932.573583:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1785389932.576518:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a357100 x1872116879220992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389932.576665:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879220992:0@lo:13: 00010000:00010000:0.0:1785389933.017659:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785389933.988642:0:7852:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1785389934.050452:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389935.061723:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389936.092544:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389936.665412:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879221504:0@lo:400: 00000100:00100000:1.0:1785389936.665509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389936.665625:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785389936.665632:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879221120:0@lo:400: 00000100:00100000:0.0:1785389936.665958:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221504 00000100:00100000:0.0:1785389936.665968:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221504 00000100:00100000:0.0:1785389936.666051:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785389936.666062:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879221504:12345-0@lo:400: 00000100:00100000:2.0:1785389936.691685:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879221376:0@lo:400: 00000100:00100000:1.0:1785389936.696378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389936.696467:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879221632:0@lo:400: 00000100:00100000:1.0:1785389936.696562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389936.696628:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221632 00000100:00100000:1.0:1785389936.696638:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221632 00000100:00100000:1.0:1785389936.696707:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785389936.696718:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879221632:12345-0@lo:400: 00000100:00100000:1.0:1785389936.696783:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879221632:12345-0@lo:400: Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389936.696791:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1785389936.696855:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac0a80 x1872116879221632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389936.696871:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879221632:0@lo:400: 00000100:00100000:3.0:1785389936.697195:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879221248:0@lo:400: 00000100:00100000:3.0:1785389936.697234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389936.697263:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879221760:0@lo:400: 00000100:00100000:3.0:1785389936.697290:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389936.697316:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221248 00000100:00100000:3.0:1785389936.697331:0:6598:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1785389936.697341:0:6598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1785389936.697378:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221248 00000100:00100000:1.0:1785389936.697410:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785389936.697418:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879221248:12345-0@lo:400: 00000100:00100000:1.0:1785389936.697474:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879221248:12345-0@lo:400: Request processed in 56us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389936.697480:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1785389936.697511:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac2680 x1872116879221248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389936.697521:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879221248:0@lo:400: 00000100:00100000:1.0:1785389936.698652:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221760 00000100:00100000:1.0:1785389936.698660:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221760 00000100:00100000:1.0:1785389936.698692:0:6598:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1785389936.698702:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785389936.698710:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879221760:12345-0@lo:400: 00000100:00100000:1.0:1785389936.698767:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879221760:12345-0@lo:400: Request processed in 57us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389936.698789:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1785389936.699134:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac1500 x1872116879221760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389936.699151:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879221760:0@lo:400: 00000100:00080000:1.0:1785389936.699662:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785389936.699668:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785389936.699671:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785389936.700093:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879221504:12345-0@lo:400: Request processed in 34030us (34581us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389936.700105:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1785389936.700155:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac3480 x1872116879221504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389936.700168:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879221504:0@lo:400: 00000100:00100000:2.0:1785389936.700912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389936.701159:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221120 00000100:00100000:3.0:1785389936.701167:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221120 00000100:00100000:3.0:1785389936.701212:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785389936.701222:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879221120:12345-0@lo:400: 00000100:00100000:3.0:1785389936.701274:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879221120:12345-0@lo:400: Request processed in 54us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389936.701281:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1785389936.702305:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879221120:0@lo:400: 00000100:00100000:1.0:1785389936.702440:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221376 00000100:00100000:1.0:1785389936.702446:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221376 00000100:00100000:1.0:1785389936.702494:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785389936.702503:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879221376:12345-0@lo:400: 00000100:00100000:1.0:1785389936.702605:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879221376:12345-0@lo:400: Request processed in 104us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389936.702624:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1785389936.702726:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785389936.702954:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac3b80 x1872116879221376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389936.702968:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879221376:0@lo:400: 00010000:00010000:0.0:1785389937.111219:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389937.176314:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879221888:0@lo:13: 00000100:00100000:2.0:1785389937.176410:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389937.176496:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879221888 00000100:00100000:2.0:1785389937.176505:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879221888 00000100:00100000:2.0:1785389937.176596:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785389937.176607:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879221888:12345-0@lo:13: 00002000:00000024:2.0:1785389937.176648:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785389937.176698:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879221888:12345-0@lo:13: Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389937.176712:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1785389937.176764:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53ff8f100 x1872116879221888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389937.176784:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879221888:0@lo:13: 00000001:00080000:1.0:1785389937.332295:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1785389937.687346:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785389937.687375:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879222016:0@lo:13: 00000100:00100000:2.0:1785389937.687472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389937.687683:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222016 00000100:00100000:0.0:1785389937.687694:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222016 00000100:00100000:0.0:1785389937.687767:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785389937.687779:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879222016:12345-0@lo:13: 00002000:00000024:0.0:1785389937.687821:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389937.687875:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879222016:12345-0@lo:13: Request processed in 99us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389937.687882:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1785389937.689871:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a357100 x1872116879222016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389937.689896:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879222016:0@lo:13: 00010000:00010000:0.0:1785389938.143356:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389939.164391:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389940.184196:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389941.205682:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389941.790278:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879222144:0@lo:400: 00000100:00100000:1.0:1785389941.790342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389941.790379:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879222656:0@lo:400: 00000100:00100000:1.0:1785389941.790400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389941.790421:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785389941.790425:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879222528:0@lo:400: 00000100:00100000:1.0:1785389941.790444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389941.790465:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879222272:0@lo:400: 00000100:00100000:1.0:1785389941.790482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389941.790493:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879222784:0@lo:400: 00000100:00100000:1.0:1785389941.790507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389941.790547:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785389941.790552:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879222400:0@lo:400: 00000100:00100000:1.0:1785389941.790572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389941.790598:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222144 00000100:00100000:1.0:1785389941.790605:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222144 00000100:00100000:1.0:1785389941.790639:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1785389941.790646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879222144:12345-0@lo:400: 00000100:00100000:1.0:1785389941.790685:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879222144:12345-0@lo:400: Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389941.790691:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1785389941.790715:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222656 00000100:00100000:1.0:1785389941.790718:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222656 00000100:00100000:1.0:1785389941.790742:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222272 00000100:00100000:1.0:1785389941.790755:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222272 00000100:00100000:1.0:1785389941.790765:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222400 00000100:00100000:1.0:1785389941.790767:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222400 00000100:00100000:1.0:1785389941.790778:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785389941.790782:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879222656:12345-0@lo:400: 00000100:00100000:1.0:1785389941.790808:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879222656:12345-0@lo:400: Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389941.790813:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785389941.790822:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785389941.790826:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879222272:12345-0@lo:400: 00000100:00100000:1.0:1785389941.790848:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879222272:12345-0@lo:400: Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389941.790852:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785389941.790860:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785389941.790864:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879222400:12345-0@lo:400: 00000100:00100000:1.0:1785389941.790882:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879222400:12345-0@lo:400: Request processed in 18us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389941.790886:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785389941.790898:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222528 00000100:00100000:1.0:1785389941.790901:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222528 00000100:00100000:1.0:1785389941.790920:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222784 00000100:00100000:1.0:1785389941.790922:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222784 00000100:00100000:1.0:1785389941.790936:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785389941.790941:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879222528:12345-0@lo:400: 00000100:00100000:1.0:1785389941.790963:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879222528:12345-0@lo:400: Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389941.790968:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785389941.790976:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785389941.790986:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879222784:12345-0@lo:400: 00000100:00100000:1.0:1785389941.791008:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879222784:12345-0@lo:400: Request processed in 23us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389941.791013:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1785389941.791054:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac1c00 x1872116879222528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389941.791066:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879222528:0@lo:400: 00000100:00100000:1.0:1785389941.791073:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879222144:0@lo:400: 00010000:00080000:1.0:1785389941.791080:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac2a00 x1872116879222656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389941.791088:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879222656:0@lo:400: 00000100:00080000:1.0:1785389941.791107:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785389941.791111:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785389941.791113:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785389941.791125:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac0a80 x1872116879222400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389941.791132:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879222400:0@lo:400: 00010000:00080000:1.0:1785389941.791139:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac2680 x1872116879222272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785389957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389941.791145:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879222272:0@lo:400: 00010000:00080000:1.0:1785389941.791152:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac1f80 x1872116879222784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389941.791157:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1785389941.791166:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879222784:0@lo:400: 00010000:00010000:3.0:1785389942.230663:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389942.298453:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785389942.298478:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879222912:0@lo:13: 00000100:00100000:1.0:1785389942.298573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389942.298686:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879222912 00000100:00100000:0.0:1785389942.298694:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879222912 00000100:00100000:0.0:1785389942.298750:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785389942.298759:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879222912:12345-0@lo:13: 00002000:00000024:0.0:1785389942.298791:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389942.298848:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879222912:12345-0@lo:13: Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389942.298855:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1785389942.299114:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac1f80 x1872116879222912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389942.299145:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879222912:0@lo:13: 00000100:00100000:3.0:1785389942.519901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389942.519932:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739008 00000100:00100000:3.0:1785389942.519941:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739008 00000100:00100000:3.0:1785389942.519977:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:3.0:1785389942.519985:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1872116847739008:12345-192.168.202.54@tcp:250: 00010000:00080000:3.0:1785389942.520013:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from dfce36af-778b-4771-80c2-03c6feec7bb9@192.168.202.54@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1785389942.520807:0:5797:0:(genops.c:1406:class_connect()) connect: client dfce36af-778b-4771-80c2-03c6feec7bb9, cookie 0x33dffe75ff5ecc10 00000100:00080000:3.0:1785389942.520935:0:5797:0:(import.c:65:import_set_state_nolock()) ffff8cf510f90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785389942.520995:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+5:2356:x1872116847739008:12345-192.168.202.54@tcp:250: Request processed in 1008us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.521003:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:2.0:1785389942.547840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389942.547910:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739136 00000100:00100000:0.0:1785389942.547920:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739136 00000100:00100000:0.0:1785389942.547968:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:0.0:1785389942.547977:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+5:5568:x1872116847739136:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1785389942.547993:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389942.548009:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be1a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389942.548044:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389942.548054:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389942.548062:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fd600, rc 0) 00000100:00100000:0.0:1785389942.548108:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+6:5568:x1872116847739136:12345-192.168.202.54@tcp:101: Request processed in 132us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389942.548114:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:2.0:1785389942.578425:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389942.578600:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739264 00000100:00100000:1.0:1785389942.578609:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739264 00000100:00100000:1.0:1785389942.578654:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:1.0:1785389942.578663:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+6:5568:x1872116847739264:12345-192.168.202.54@tcp:501: 00000100:00100000:1.0:1785389942.578942:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+6:5568:x1872116847739264:12345-192.168.202.54@tcp:501: Request processed in 279us (525us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785389942.578950:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:3.0:1785389942.581989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389942.582126:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739392 00000100:00100000:2.0:1785389942.582134:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739392 00000100:00100000:2.0:1785389942.582186:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:2.0:1785389942.582195:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+6:5568:x1872116847739392:12345-192.168.202.54@tcp:101: 00010000:00010000:2.0:1785389942.582212:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389942.582229:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be21 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389942.582255:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389942.582267:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389942.582299:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529e00, rc 0) 00000100:00100000:2.0:1785389942.582344:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+7:5568:x1872116847739392:12345-192.168.202.54@tcp:101: Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389942.582351:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:1.0:1785389942.589602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389942.589669:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739520 00000100:00100000:3.0:1785389942.589679:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739520 00000100:00100000:3.0:1785389942.589740:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:3.0:1785389942.589750:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+7:5568:x1872116847739520:12345-192.168.202.54@tcp:501: 00000100:00100000:3.0:1785389942.590031:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5568:x1872116847739520:12345-192.168.202.54@tcp:501: Request processed in 272us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.590040:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1785389942.599801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389942.600145:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739648 00000100:00100000:1.0:1785389942.600156:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739648 00000100:00100000:1.0:1785389942.600195:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:1.0:1785389942.600204:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5568:x1872116847739648:12345-192.168.202.54@tcp:503: 00000100:00100000:1.0:1785389942.600451:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5568:x1872116847739648:12345-192.168.202.54@tcp:503: Request processed in 247us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389942.600459:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:0.0:1785389942.623949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389942.624041:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739776 00000100:00100000:3.0:1785389942.624052:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739776 00000100:00100000:3.0:1785389942.624100:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:3.0:1785389942.624109:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5587:x1872116847739776:12345-192.168.202.54@tcp:502: 00000100:00100000:3.0:1785389942.624576:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5587:x1872116847739776:12345-192.168.202.54@tcp:502: Request processed in 466us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.624585:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1785389942.696197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389942.697211:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847739904 00000100:00100000:1.0:1785389942.697221:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847739904 00000100:00100000:1.0:1785389942.697279:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:1.0:1785389942.697288:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5587:x1872116847739904:12345-192.168.202.54@tcp:502: 00000100:00100000:1.0:1785389942.697574:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5587:x1872116847739904:12345-192.168.202.54@tcp:502: Request processed in 285us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389942.697583:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1785389942.713199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389942.713231:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740032 00000100:00100000:2.0:1785389942.713241:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740032 00000100:00100000:2.0:1785389942.713291:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:2.0:1785389942.713299:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5568:x1872116847740032:12345-192.168.202.54@tcp:101: 00010000:00010000:2.0:1785389942.713316:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389942.713331:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529600/0x33dffe75ff5ecc25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be4b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389942.713358:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529600/0x33dffe75ff5ecc25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be4b expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389942.713368:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529600/0x33dffe75ff5ecc25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be4b expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389942.713378:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529600, rc 0) 00000100:00100000:2.0:1785389942.713426:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5568:x1872116847740032:12345-192.168.202.54@tcp:101: Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389942.713433:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:1.0:1785389942.743356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389942.743497:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740160 00000100:00100000:2.0:1785389942.743508:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740160 00000100:00100000:2.0:1785389942.743588:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:2.0:1785389942.743596:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5568:x1872116847740160:12345-192.168.202.54@tcp:256: 20000000:01000000:2.0:1785389942.743622:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785389942.743640:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785389942.743644:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785389942.743647:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785389942.743649:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1785389942.748076:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5568:x1872116847740160:12345-192.168.202.54@tcp:256: Request processed in 4472us (4721us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.748088:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:3.0:1785389942.767336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389942.767414:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740288 00000100:00100000:0.0:1785389942.767424:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740288 00000100:00100000:0.0:1785389942.767478:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:0.0:1785389942.767487:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5568:x1872116847740288:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1785389942.767506:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389942.767549:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be52 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389942.767578:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389942.767590:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389942.767598:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fc800, rc 0) 00000100:00100000:0.0:1785389942.767643:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5568:x1872116847740288:12345-192.168.202.54@tcp:101: Request processed in 157us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389942.767650:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:1.0:1785389942.778782:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389942.778888:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740416 00000100:00100000:2.0:1785389942.778897:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740416 00000100:00100000:2.0:1785389942.778950:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:2.0:1785389942.778959:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5568:x1872116847740416:12345-192.168.202.54@tcp:501: 00000100:00100000:2.0:1785389942.779234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5568:x1872116847740416:12345-192.168.202.54@tcp:501: Request processed in 275us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389942.779242:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1785389942.788461:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389942.793675:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740544 00000100:00100000:3.0:1785389942.793689:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740544 00000100:00100000:3.0:1785389942.793757:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:3.0:1785389942.793767:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5568:x1872116847740544:12345-192.168.202.54@tcp:503: 00000100:00100000:3.0:1785389942.794156:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5568:x1872116847740544:12345-192.168.202.54@tcp:503: Request processed in 388us (5700us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.794164:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:1.0:1785389942.801224:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389942.804658:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740672 00000100:00100000:2.0:1785389942.804674:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740672 00000100:00100000:2.0:1785389942.804739:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:2.0:1785389942.804747:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5592:x1872116847740672:12345-192.168.202.54@tcp:502: 00000100:00100000:2.0:1785389942.805034:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5592:x1872116847740672:12345-192.168.202.54@tcp:502: Request processed in 287us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389942.805043:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:1.0:1785389942.812838:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785389942.812865:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879223040:0@lo:13: 00000100:00100000:1.0:1785389942.812939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389942.813028:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223040 00000100:00100000:1.0:1785389942.813035:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223040 00000100:00100000:1.0:1785389942.813095:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785389942.813107:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879223040:12345-0@lo:13: 00002000:00000024:1.0:1785389942.813147:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389942.813198:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879223040:12345-0@lo:13: Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389942.813207:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1785389942.813257:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac0a80 x1872116879223040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389942.813289:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879223040:0@lo:13: 00000100:00100000:1.0:1785389942.815228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389942.815291:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740800 00000100:00100000:3.0:1785389942.815299:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740800 00000100:00100000:3.0:1785389942.815343:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:3.0:1785389942.815352:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5592:x1872116847740800:12345-192.168.202.54@tcp:502: 00000100:00100000:3.0:1785389942.815615:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5592:x1872116847740800:12345-192.168.202.54@tcp:502: Request processed in 262us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.815622:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:1.0:1785389942.818630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389942.818770:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847740928 00000100:00100000:3.0:1785389942.818778:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847740928 00000100:00100000:3.0:1785389942.818859:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1785389942.818868:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1872116847740928:12345-192.168.202.54@tcp:38: 00010000:00080000:3.0:1785389942.818894:0:5802:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1785389942.818938:0:5802:0:(genops.c:1406:class_connect()) connect: client db9e37b8-1bb4-4113-a95f-cdba66461e5f, cookie 0x33dffe75ff5ecc33 00000004:00100000:3.0:1785389942.818966:0:5802:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1785389942.818972:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1785389942.896243:0:5802:0:(import.c:65:import_set_state_nolock()) ffff8cf510f96800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785389942.896401:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2356:x1872116847740928:12345-192.168.202.54@tcp:38: Request processed in 77531us (77775us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389942.896413:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00010000:00010000:2.0:1785389943.259318:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389943.902008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389943.902101:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741184 00000100:00100000:1.0:1785389943.902111:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741184 00000100:00080000:0.0:1785389943.902257:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389943.903871:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1785389943.903885:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5568:x1872116847741184:12345-192.168.202.54@tcp:41: 00000004:00000024:1.0:1785389943.903929:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785389943.904003:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5568:x1872116847741184:12345-192.168.202.54@tcp:41: Request processed in 123us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389943.904011:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:0.0:1785389943.918468:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389943.918625:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741056 00000100:00100000:1.0:1785389943.918635:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741056 00000100:00100000:1.0:1785389943.918684:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1785389943.918693:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:0:x1872116847741056:12345-192.168.202.54@tcp:41: 00000004:00000024:1.0:1785389943.918723:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1785389943.918783:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:0:x1872116847741056:12345-192.168.202.54@tcp:41: Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389943.918789:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:0.0:1785389943.919014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389943.919191:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741312 00000100:00100000:3.0:1785389943.919203:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741312 00000100:00100000:3.0:1785389943.919268:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:3.0:1785389943.919278:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5568:x1872116847741312:12345-192.168.202.54@tcp:40: 00000100:00100000:3.0:1785389943.919370:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5568:x1872116847741312:12345-192.168.202.54@tcp:40: Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389943.919378:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1785389943.925610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389943.925656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389943.925699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389943.925733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389943.925766:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741440 00000100:00100000:0.0:1785389943.925775:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741440 00000100:00100000:0.0:1785389943.925808:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741568 00000100:00100000:0.0:1785389943.925818:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741568 00000100:00100000:0.0:1785389943.925839:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:0.0:1785389943.925848:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1872116847741440:12345-192.168.202.54@tcp:8: 00010000:00080000:0.0:1785389943.925879:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1785389943.925921:0:6599:0:(genops.c:1406:class_connect()) connect: client db9e37b8-1bb4-4113-a95f-cdba66461e5f, cookie 0x33dffe75ff5ecc3a 00002000:00100000:0.0:1785389943.925932:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli db9e37b8-1bb4-4113-a95f-cdba66461e5f/ffff8cf51f0e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785389943.925941:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1785389943.926162:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1785389943.926168:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1872116847741568:12345-192.168.202.54@tcp:8: 00010000:00080000:1.0:1785389943.926184:0:6598:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1785389943.926201:0:6598:0:(genops.c:1406:class_connect()) connect: client db9e37b8-1bb4-4113-a95f-cdba66461e5f, cookie 0x33dffe75ff5ecc41 00002000:00100000:1.0:1785389943.926205:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db9e37b8-1bb4-4113-a95f-cdba66461e5f/ffff8cf50e0b0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785389943.926220:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1785389943.926479:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1785389943.926514:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8cf50e0b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785389943.926593:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2356:x1872116847741568:12345-192.168.202.54@tcp:8: Request processed in 423us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389943.926601:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:3.0:1785389943.926718:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741824 00000100:00100000:3.0:1785389943.926731:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741824 00000100:00100000:2.0:1785389943.926894:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741696 00000100:00100000:2.0:1785389943.926900:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741696 00000100:00100000:2.0:1785389943.926933:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1785389943.926940:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5568:x1872116847741696:12345-192.168.202.54@tcp:33: 00000100:00100000:3.0:1785389943.930663:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:3.0:1785389943.930681:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847741824:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1785389943.930831:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847741824:12345-192.168.202.54@tcp:400: Request processed in 156us (5173us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389943.930837:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00002000:00080000:0.0:1785389943.932266:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785389943.932313:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785389943.932561:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2356:x1872116847741440:12345-192.168.202.54@tcp:8: Request processed in 6710us (6857us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389943.932572:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000004:00080000:2.0:1785389943.980373:0:5805:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 53380us 00000004:00200000:3.0:1785389943.997298:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1785389943.997468:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5568:x1872116847741696:12345-192.168.202.54@tcp:33: Request processed in 70523us (71861us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389943.997483:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:2.0:1785389944.258814:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389944.258900:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847741952 00000100:00100000:3.0:1785389944.258910:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847741952 00000100:00100000:3.0:1785389944.258972:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:3.0:1785389944.258982:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5609:x1872116847741952:12345-192.168.202.54@tcp:101: 00010000:00010000:3.0:1785389944.259013:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389944.259036:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5400/0x33dffe75ff5ecc48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be7c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389944.259098:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecc4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389944.259111:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecc4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389944.259123:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecc4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785389944.259306:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1785389944.259311:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1785389944.259383:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecc4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389944.259409:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5400/0x33dffe75ff5ecc48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be7c expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389944.259427:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecc4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be7c expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389944.259435:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:3.0:1785389944.259438:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785389944.259442:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5a00, rc 0) 00000100:00100000:3.0:1785389944.259514:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:5609:x1872116847741952:12345-192.168.202.54@tcp:101: Request processed in 533us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389944.259576:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00010000:00010000:3.0:1785389944.277759:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389945.302461:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785389945.458754:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00010000:00010000:3.0:1785389946.329185:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389946.904567:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879223424:0@lo:400: 00000100:00100000:2.0:1785389946.904642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389946.904700:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785389946.904706:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879223296:0@lo:400: 00000100:00100000:2.0:1785389946.904726:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389946.905004:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879223808:0@lo:400: 00000100:00100000:2.0:1785389946.905030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389946.905100:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223424 00000100:00100000:0.0:1785389946.905107:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223424 00000100:00100000:0.0:1785389946.905159:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223296 00000100:00100000:0.0:1785389946.905162:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223296 00000100:00100000:0.0:1785389946.905180:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785389946.905188:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879223424:12345-0@lo:400: 00000100:00100000:0.0:1785389946.905239:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879223424:12345-0@lo:400: Request processed in 52us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389946.905246:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1785389946.905261:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785389946.905267:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879223296:12345-0@lo:400: 00000100:00100000:0.0:1785389946.905289:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879223296:12345-0@lo:400: Request processed in 22us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389946.905309:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785389946.905352:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879223296:0@lo:400: 00000100:00100000:0.0:1785389946.905363:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879223424:0@lo:400: 00000100:00100000:3.0:1785389946.905696:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879223552:0@lo:400: 00000100:00100000:3.0:1785389946.905725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389946.905761:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1785389946.905767:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879223168:0@lo:400: 00000100:00100000:3.0:1785389946.905791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389946.905811:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879223680:0@lo:400: 00000100:00100000:3.0:1785389946.905831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389946.905856:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223680 00000100:00100000:3.0:1785389946.905859:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223680 00000100:00100000:3.0:1785389946.905899:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785389946.905912:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879223680:12345-0@lo:400: 00000100:00100000:3.0:1785389946.905946:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879223680:12345-0@lo:400: Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389946.905951:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785389946.905977:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879223680:0@lo:400: 00000100:00100000:0.0:1785389946.906167:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223808 00000100:00100000:0.0:1785389946.906171:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223808 00000100:00100000:0.0:1785389946.906208:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223552 00000100:00100000:0.0:1785389946.906211:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223552 00000100:00100000:0.0:1785389946.906232:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785389946.906239:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879223808:12345-0@lo:400: 00000100:00100000:0.0:1785389946.906278:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879223808:12345-0@lo:400: Request processed in 40us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389946.906284:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1785389946.906296:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785389946.906302:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879223552:12345-0@lo:400: 00000100:00100000:0.0:1785389946.906347:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879223552:12345-0@lo:400: Request processed in 45us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389946.906352:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1785389946.906379:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53ff8f800 x1872116879223808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389946.906401:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879223808:0@lo:400: 00000100:00080000:2.0:1785389946.906566:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785389946.906581:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785389946.906584:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389946.906702:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223168 00000100:00100000:1.0:1785389946.906707:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223168 00000100:00100000:1.0:1785389946.906753:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1785389946.906761:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879223168:12345-0@lo:400: 00000100:00100000:1.0:1785389946.906798:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879223168:12345-0@lo:400: Request processed in 39us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389946.906814:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1785389946.907875:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879223168:0@lo:400: 00010000:00080000:3.0:1785389946.907889:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53ff8ca80 x1872116879223552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389946.907899:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879223552:0@lo:400: 00010000:00010000:2.0:1785389947.349703:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389947.415177:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785389947.436248:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879223936:0@lo:13: 00000100:00100000:2.0:1785389947.436329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389947.438873:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879223936 00000100:00100000:1.0:1785389947.439215:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879223936 00000100:00100000:1.0:1785389947.439291:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785389947.439302:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879223936:12345-0@lo:13: 00002000:00000024:1.0:1785389947.439342:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389947.439427:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879223936:12345-0@lo:13: Request processed in 128us (3098us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389947.439435:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1785389947.439568:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac1500 x1872116879223936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389947.439587:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879223936:0@lo:13: 00000100:00100000:2.0:1785389947.688596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389947.688736:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742080 00000100:00100000:0.0:1785389947.688747:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742080 00000100:00100000:0.0:1785389947.688820:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1785389947.688830:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:5662:x1872116847742080:12345-192.168.202.54@tcp:41: 00000004:00000024:0.0:1785389947.688887:0:7121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1785389947.688993:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:5662:x1872116847742080:12345-192.168.202.54@tcp:41: Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389947.689000:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:2.0:1785389947.689456:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389947.709616:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389947.709688:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742208 00000100:00100000:1.0:1785389947.709698:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742208 00000100:00100000:1.0:1785389947.709773:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1785389947.709783:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:5662:x1872116847742208:12345-192.168.202.54@tcp:13: 00002000:00000024:1.0:1785389947.709822:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389947.709899:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:5662:x1872116847742208:12345-192.168.202.54@tcp:13: Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389947.709907:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00080000:2.0:1785389947.710511:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785389947.717166:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389947.717255:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742336 00000100:00100000:0.0:1785389947.717264:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742336 00000100:00100000:0.0:1785389947.717328:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785389947.717337:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5662:x1872116847742336:12345-192.168.202.54@tcp:13: 00002000:00000024:0.0:1785389947.717361:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389947.717420:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:5662:x1872116847742336:12345-192.168.202.54@tcp:13: Request processed in 84us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389947.717426:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00080000:2.0:1785389947.717711:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785389947.929107:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785389947.929133:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879224064:0@lo:13: 00000100:00100000:2.0:1785389947.929203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389947.929340:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224064 00000100:00100000:0.0:1785389947.929348:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224064 00000100:00100000:0.0:1785389947.929396:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785389947.929406:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879224064:12345-0@lo:13: 00002000:00000024:0.0:1785389947.929429:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389947.929487:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879224064:12345-0@lo:13: Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389947.929493:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1785389947.929678:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac3480 x1872116879224064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389947.929694:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879224064:0@lo:13: 00000001:00100000:3.0:1785389948.016055:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00010000:00010000:3.0:1785389948.375568:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785389949.123194:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000100:00100000:2.0:1785389949.368616:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389949.368649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389949.368675:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389949.368696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389949.368722:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742848 00000100:00100000:2.0:1785389949.368730:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742848 00000100:00100000:2.0:1785389949.368779:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742720 00000100:00100000:2.0:1785389949.368781:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742720 00000100:00100000:2.0:1785389949.368801:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1785389949.368810:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847742848:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1785389949.368873:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847742848:12345-192.168.202.54@tcp:400: Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389949.368879:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1785389949.368904:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785389949.368910:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847742720:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1785389949.368933:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847742720:12345-192.168.202.54@tcp:400: Request processed in 24us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389949.368938:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785389949.368953:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742464 00000100:00100000:2.0:1785389949.368955:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742464 00000100:00100000:2.0:1785389949.368976:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:2.0:1785389949.368981:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847742464:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1785389949.369148:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847742464:12345-192.168.202.54@tcp:400: Request processed in 165us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389949.369165:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00080000:2.0:1785389949.369195:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785389949.369198:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785389949.370899:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742592 00000100:00100000:0.0:1785389949.370907:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742592 00000100:00100000:0.0:1785389949.370954:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:0.0:1785389949.370961:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847742592:12345-192.168.202.54@tcp:400: 00000100:00100000:0.0:1785389949.371016:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847742592:12345-192.168.202.54@tcp:400: Request processed in 55us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389949.371023:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00080000:2.0:1785389949.371444:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785389949.397646:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389950.421848:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389951.445753:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389952.021766:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879224320:0@lo:400: 00000100:00100000:2.0:1785389952.021835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389952.021910:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785389952.021916:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879224448:0@lo:400: 00000100:00100000:2.0:1785389952.021935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389952.022005:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879224832:0@lo:400: 00000100:00100000:2.0:1785389952.022032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389952.022067:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224832 00000100:00100000:2.0:1785389952.022074:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224832 00000100:00100000:2.0:1785389952.022127:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785389952.022137:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879224832:12345-0@lo:400: 00000100:00100000:2.0:1785389952.022185:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879224832:12345-0@lo:400: Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389952.022192:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1785389952.022224:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785389952.022248:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc32a00 x1872116879224832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389952.022262:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879224832:0@lo:400: 00000100:00100000:3.0:1785389952.022399:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879224576:0@lo:400: 00000100:00100000:3.0:1785389952.022439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389952.022463:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1785389952.022468:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879224192:0@lo:400: 00000100:00100000:3.0:1785389952.022493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389952.022515:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879224704:0@lo:400: 00000100:00100000:3.0:1785389952.022557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389952.022583:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224320 00000100:00100000:3.0:1785389952.022586:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224320 00000100:00100000:3.0:1785389952.022610:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224448 00000100:00100000:3.0:1785389952.022613:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224448 00000100:00100000:3.0:1785389952.022631:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224704 00000100:00100000:3.0:1785389952.022634:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224704 00000100:00100000:3.0:1785389952.022648:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785389952.022654:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879224320:12345-0@lo:400: 00000100:00100000:3.0:1785389952.022692:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879224320:12345-0@lo:400: Request processed in 37us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389952.022697:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785389952.022709:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785389952.022714:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879224448:12345-0@lo:400: 00000100:00100000:3.0:1785389952.022740:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879224448:12345-0@lo:400: Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389952.022744:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1785389952.022753:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785389952.022760:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879224704:12345-0@lo:400: 00000100:00100000:3.0:1785389952.022789:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879224704:12345-0@lo:400: Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389952.022803:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785389952.022820:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224192 00000100:00100000:3.0:1785389952.022824:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224192 00000100:00100000:3.0:1785389952.022847:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1785389952.022852:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879224192:12345-0@lo:400: 00000100:00100000:3.0:1785389952.022882:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879224192:12345-0@lo:400: Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389952.022888:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1785389952.022915:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785389952.022934:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879224448:0@lo:400: 00000100:00100000:3.0:1785389952.022945:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879224320:0@lo:400: 00000100:00100000:3.0:1785389952.022971:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879224192:0@lo:400: 00000100:00100000:3.0:1785389952.022980:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879224704:0@lo:400: 00000100:00100000:2.0:1785389952.023755:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224576 00000100:00100000:2.0:1785389952.023761:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224576 00000100:00100000:2.0:1785389952.023814:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785389952.023822:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879224576:12345-0@lo:400: 00000100:00100000:2.0:1785389952.023870:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879224576:12345-0@lo:400: Request processed in 49us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389952.023876:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1785389952.023939:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc31880 x1872116879224576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389952.023949:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879224576:0@lo:400: 00000100:00080000:3.0:1785389952.024051:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1785389952.395493:0:8163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1785389952.484609:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389952.539541:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879224960:0@lo:13: 00000100:00100000:2.0:1785389952.539614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389952.539753:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879224960 00000100:00100000:1.0:1785389952.539761:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879224960 00000100:00100000:1.0:1785389952.539809:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785389952.539817:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879224960:12345-0@lo:13: 00002000:00000024:1.0:1785389952.539861:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389952.539904:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879224960:12345-0@lo:13: Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389952.539911:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1785389952.540510:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac3480 x1872116879224960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389952.540556:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879224960:0@lo:13: 00000100:00100000:2.0:1785389953.046712:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785389953.046735:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879225088:0@lo:13: 00000100:00100000:2.0:1785389953.046795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389953.046978:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225088 00000100:00100000:1.0:1785389953.046986:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225088 00000100:00100000:1.0:1785389953.047034:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785389953.047044:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879225088:12345-0@lo:13: 00002000:00000024:1.0:1785389953.047074:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389953.047124:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879225088:12345-0@lo:13: Request processed in 82us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389953.047130:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1785389953.047231:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac1500 x1872116879225088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389953.047248:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879225088:0@lo:13: 00010000:00010000:2.0:1785389953.493663:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389954.478517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389954.478578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389954.478761:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847742976 00000100:00100000:1.0:1785389954.478770:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847742976 00000100:00100000:1.0:1785389954.478816:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:1.0:1785389954.478825:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847742976:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1785389954.478907:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847742976:12345-192.168.202.54@tcp:400: Request processed in 82us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389954.478914:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:3.0:1785389954.479622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389954.479656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389954.479684:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743104 00000100:00100000:3.0:1785389954.479690:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743104 00000100:00100000:3.0:1785389954.479729:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1785389954.479736:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847743104:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1785389954.479784:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847743104:12345-192.168.202.54@tcp:400: Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389954.479791:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00080000:3.0:1785389954.479809:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785389954.479832:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743232 00000100:00100000:3.0:1785389954.479836:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743232 00000100:00100000:3.0:1785389954.479983:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743360 00000100:00100000:3.0:1785389954.479988:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743360 00000100:00100000:3.0:1785389954.480013:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1785389954.480020:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847743232:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1785389954.480048:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847743232:12345-192.168.202.54@tcp:400: Request processed in 28us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389954.480054:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1785389954.480064:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1785389954.480070:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847743360:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1785389954.480091:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847743360:12345-192.168.202.54@tcp:400: Request processed in 21us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389954.480096:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00080000:3.0:1785389954.480107:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785389954.480109:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785389954.517638:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389955.543815:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389956.567773:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389957.141767:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879225216:0@lo:400: 00000100:00100000:3.0:1785389957.141844:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389957.141954:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879225344:0@lo:400: 00000100:00100000:2.0:1785389957.141987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389957.142041:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879225472:0@lo:400: 00000100:00100000:2.0:1785389957.142063:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389957.142094:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225344 00000100:00100000:2.0:1785389957.142101:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225344 00000100:00100000:2.0:1785389957.142139:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225472 00000100:00100000:2.0:1785389957.142142:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225472 00000100:00100000:2.0:1785389957.142183:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785389957.142191:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879225344:12345-0@lo:400: 00000100:00100000:2.0:1785389957.142234:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879225344:12345-0@lo:400: Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389957.142240:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1785389957.142265:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1785389957.142271:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879225472:12345-0@lo:400: 00000100:00100000:2.0:1785389957.142296:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879225472:12345-0@lo:400: Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389957.142302:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1785389957.142321:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389957.142350:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879225472:0@lo:400: 00000100:00100000:2.0:1785389957.142378:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879225344:0@lo:400: 00000100:00100000:1.0:1785389957.142478:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879225600:0@lo:400: 00000100:00100000:1.0:1785389957.142508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389957.144477:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225600 00000100:00100000:1.0:1785389957.144485:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225600 00000100:00100000:1.0:1785389957.144567:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785389957.144582:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879225600:12345-0@lo:400: 00000100:00100000:1.0:1785389957.144644:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879225600:12345-0@lo:400: Request processed in 64us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389957.144661:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1785389957.144703:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc32300 x1872116879225600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389957.144716:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879225600:0@lo:400: 00000100:00080000:1.0:1785389957.144764:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785389957.144866:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225216 00000100:00100000:0.0:1785389957.144876:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225216 00000100:00100000:0.0:1785389957.144913:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1785389957.144920:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879225216:12345-0@lo:400: 00000100:00100000:2.0:1785389957.148168:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879225856:0@lo:400: 00000100:00100000:2.0:1785389957.148228:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389957.148278:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225856 00000100:00100000:2.0:1785389957.148284:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225856 00000100:00100000:2.0:1785389957.148332:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785389957.148340:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879225856:12345-0@lo:400: 00000100:00100000:2.0:1785389957.148395:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879225856:12345-0@lo:400: Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389957.148401:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1785389957.148430:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785389957.148454:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc31180 x1872116879225856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389957.148466:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879225856:0@lo:400: 00000100:00100000:1.0:1785389957.148599:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785389957.148608:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879225728:0@lo:400: 00000100:00100000:1.0:1785389957.148639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389957.149059:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225728 00000100:00100000:2.0:1785389957.149064:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225728 00000100:00100000:0.0:1785389957.149159:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879225216:12345-0@lo:400: Request processed in 4238us (7312us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389957.149168:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1785389957.149675:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1785389957.149683:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879225728:12345-0@lo:400: 00000100:00100000:2.0:1785389957.149728:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879225728:12345-0@lo:400: Request processed in 47us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389957.149735:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1785389957.149766:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879225728:0@lo:400: 00000100:00100000:3.0:1785389957.151161:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879225216:0@lo:400: 00000100:00080000:1.0:1785389957.151661:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785389957.593166:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389957.662585:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785389957.662620:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879225984:0@lo:13: 00000100:00100000:0.0:1785389957.662704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389957.667601:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879225984 00000100:00100000:1.0:1785389957.667615:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879225984 00000100:00100000:1.0:1785389957.667703:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785389957.667712:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879225984:12345-0@lo:13: 00002000:00000024:1.0:1785389957.667790:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389957.667870:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879225984:12345-0@lo:13: Request processed in 160us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389957.667876:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1785389957.667930:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac3480 x1872116879225984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389957.667946:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879225984:0@lo:13: 00000100:00100000:3.0:1785389958.167427:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879226112:0@lo:13: 00000100:00100000:3.0:1785389958.167510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.167616:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879226112 00000100:00100000:3.0:1785389958.167624:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879226112 00000100:00100000:3.0:1785389958.167667:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785389958.167677:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879226112:12345-0@lo:13: 00002000:00000024:3.0:1785389958.167708:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785389958.167750:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879226112:12345-0@lo:13: Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.167757:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1785389958.167794:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535ac3480 x1872116879226112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389958.167810:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879226112:0@lo:13: 00000020:00000080:3.0:1785389958.464096:0:8312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4a93b700 20000000:00000080:3.0:1785389958.464114:0:8312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf535fa8400 uarg=0000000000000000 20000000:01000000:3.0:1785389958.464223:0:8312:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1785389958.464226:0:8312:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1785389958.464229:0:8312:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1785389958.464233:0:8312:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1785389958.464239:0:8312:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1785389958.464254:0:8312:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1785389958.464256:0:8312:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1785389958.466411:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1785389958.466417:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1785389958.470052:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1785389958.470716:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1785389958.470790:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1785389958.470831:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1785389958.470845:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1785389958.470848:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1785389958.473744:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1785389958.474179:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1785389958.474230:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1785389958.474260:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1785389958.474272:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1785389958.474274:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1785389958.475324:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1785389958.476812:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1785389958.476874:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1785389958.476920:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1785389958.476933:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1785389958.476935:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1785389958.489283:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1785389958.493851:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1785389958.493911:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1785389958.493949:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1785389958.493969:0:8312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1785389958.493990:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494007:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494016:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494023:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494031:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494038:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494053:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494060:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494069:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494077:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494084:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494123:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.494901:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 9 pid: 5797 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.494917:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226240:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785389958.495059:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495069:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 9 pid: 5795 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495078:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226368:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785389958.495121:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495140:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 18 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495149:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226496:0@lo:104: 00000100:00100000:0.0:1785389958.495188:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785389958.495233:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495241:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 18 pid: 5797 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495249:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226624:0@lo:104: 00000100:00100000:0.0:1785389958.495272:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785389958.495303:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495311:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 18 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495319:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226752:0@lo:104: 00010000:00010000:0.0:1785389958.495342:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495350:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 18 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495358:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226880:0@lo:104: 00010000:00010000:0.0:1785389958.495403:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495412:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 18 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495420:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879227008:0@lo:104: 00010000:00010000:0.0:1785389958.495442:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495449:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 18 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495456:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879227136:0@lo:104: 00010000:00010000:0.0:1785389958.495491:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.495499:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 18 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.495506:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879227264:0@lo:104: 00000100:00100000:0.0:1785389958.495546:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf52021bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1785389958.498564:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1785389958.498631:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.498655:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.498665:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.498676:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.498687:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.498697:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879226496 00000100:00100000:3.0:1785389958.498704:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879226496 00000100:00100000:3.0:1785389958.498743:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879226624 00000100:00100000:3.0:1785389958.498746:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879226624 00000100:00100000:3.0:1785389958.498755:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879226752 00000100:00100000:3.0:1785389958.498758:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879226752 00000100:00100000:3.0:1785389958.498765:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879226880 00000100:00100000:3.0:1785389958.498768:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879226880 00000100:00100000:3.0:1785389958.498776:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227008 00000100:00100000:3.0:1785389958.498778:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227008 00000100:00100000:3.0:1785389958.498786:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227136 00000100:00100000:3.0:1785389958.498787:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227136 00000100:00100000:3.0:1785389958.498794:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227264 00000100:00100000:3.0:1785389958.498796:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227264 00000100:00100000:3.0:1785389958.498806:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785389958.498814:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:8312:x1872116879226496:12345-0@lo:104: 00010000:00010000:3.0:1785389958.498828:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.498887:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785389958.498893:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+9:8312:x1872116879226496:12345-0@lo:104: Request processed in 80us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.498909:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785389958.498925:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785389958.498930:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f06e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+8:8312:x1872116879226624:12345-0@lo:104: 00010000:00010000:3.0:1785389958.498938:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.498971:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785389958.498976:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f06e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+8:8312:x1872116879226624:12345-0@lo:104: Request processed in 47us (3704us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.498982:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785389958.499015:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785389958.499020:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+7:8312:x1872116879226752:12345-0@lo:104: 00010000:00010000:3.0:1785389958.499028:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499054:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785389958.499058:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+7:8312:x1872116879226752:12345-0@lo:104: Request processed in 39us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.499064:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785389958.499076:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785389958.499081:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+6:8312:x1872116879226880:12345-0@lo:104: 00010000:00010000:3.0:1785389958.499087:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499112:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1785389958.499117:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+6:8312:x1872116879226880:12345-0@lo:104: Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.499129:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785389958.499143:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785389958.499149:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:8312:x1872116879227008:12345-0@lo:104: 00010000:00010000:3.0:1785389958.499157:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499184:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1785389958.499189:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:8312:x1872116879227008:12345-0@lo:104: Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.499194:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785389958.499204:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785389958.499210:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:8312:x1872116879227136:12345-0@lo:104: 00010000:00010000:3.0:1785389958.499217:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499243:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1785389958.499247:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:8312:x1872116879227136:12345-0@lo:104: Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.499252:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785389958.499263:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785389958.499268:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:8312:x1872116879227264:12345-0@lo:104: 00010000:00010000:3.0:1785389958.499275:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499297:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1785389958.499302:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:8312:x1872116879227264:12345-0@lo:104: Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.499313:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1785389958.499332:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1785389958.499337:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499344:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf501529a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499348:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499355:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499362:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499378:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499410:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499417:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499433:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499440:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf501529a00/0x33dffe75ff5ecbfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecc09 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499452:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1785389958.499455:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499472:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf501529000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499475:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499481:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499486:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499491:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499505:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499511:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499547:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499553:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf501529000/0x33dffe75ff5ecbd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbdf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499562:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785389958.499565:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499570:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499573:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499589:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499595:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499600:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499612:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499617:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499623:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499629:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4000/0x33dffe75ff5ecbbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbc3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499637:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785389958.499639:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499645:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4200 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499648:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499653:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499659:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499671:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499683:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499688:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499693:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499698:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecbae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecbb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499706:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785389958.499708:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499713:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500030600 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499716:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499722:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499727:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499732:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499743:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499748:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499757:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499763:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500030600/0x33dffe75ff5ecba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecba7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499772:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785389958.499775:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499780:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500030a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499782:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499788:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499794:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499799:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499811:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499817:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499821:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499827:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500030a00/0x33dffe75ff5ecb76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb7d expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499834:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785389958.499842:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499848:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500031000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785389958.499851:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499857:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785389958.499863:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389958.499869:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1785389958.499881:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499886:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785389958.499891:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499897:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500031000/0x33dffe75ff5ecb4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb53 expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.499910:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389958.499912:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389958.499913:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389958.499920:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389958.499939:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879227392:0@lo:103: 00000100:00100000:3.0:1785389958.499971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.499990:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879227904:0@lo:103: 00000100:00100000:3.0:1785389958.500015:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.500032:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785389958.500038:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879227776:0@lo:103: 00000100:00100000:3.0:1785389958.500055:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.500080:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879227648:0@lo:103: 00000100:00100000:3.0:1785389958.500100:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.500108:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879228160:0@lo:103: 00000100:00100000:3.0:1785389958.500124:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.500133:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785389958.500137:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879227520:0@lo:103: 00000100:00100000:3.0:1785389958.500153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.500161:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879228032:0@lo:103: 00000100:00100000:3.0:1785389958.500182:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389958.500200:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227392 00000100:00100000:3.0:1785389958.500204:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227392 00010000:00010000:3.0:1785389958.500223:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 19 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500237:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227904 00000100:00100000:3.0:1785389958.500240:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227904 00010000:00010000:3.0:1785389958.500249:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 20 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500260:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227776 00000100:00100000:3.0:1785389958.500262:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227776 00010000:00010000:3.0:1785389958.500270:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 21 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500279:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227648 00000100:00100000:3.0:1785389958.500287:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227648 00010000:00010000:3.0:1785389958.500300:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 22 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500310:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228160 00000100:00100000:3.0:1785389958.500313:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228160 00010000:00010000:3.0:1785389958.500321:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 23 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500331:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879227520 00000100:00100000:3.0:1785389958.500333:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879227520 00010000:00010000:3.0:1785389958.500341:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 24 pid: 5797 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500350:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228032 00000100:00100000:3.0:1785389958.500353:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228032 00010000:00010000:3.0:1785389958.500361:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 25 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.500384:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785389958.500391:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+25:3308:x1872116879227392:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500401:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500406:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 25 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500414:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 25 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500429:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500459:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+25:3308:x1872116879227392:12345-0@lo:103: Request processed in 68us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500466:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785389958.500487:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785389958.500493:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+24:3308:x1872116879227904:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500500:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500504:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 24 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500512:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 24 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500538:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500561:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+24:3308:x1872116879227904:12345-0@lo:103: Request processed in 69us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500568:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785389958.500580:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785389958.500585:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+23:3308:x1872116879227776:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500593:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500597:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 23 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500605:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 23 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500613:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500633:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+23:3308:x1872116879227776:12345-0@lo:103: Request processed in 47us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500638:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785389958.500649:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785389958.500654:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+22:3310:x1872116879227648:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500661:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500670:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 22 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500677:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 22 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500686:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500713:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+22:3310:x1872116879227648:12345-0@lo:103: Request processed in 59us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500718:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785389958.500730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785389958.500735:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+21:3310:x1872116879228160:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500743:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500746:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 21 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500754:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 21 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500763:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500781:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+21:3310:x1872116879228160:12345-0@lo:103: Request processed in 47us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500787:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785389958.500797:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785389958.500802:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3310:x1872116879227520:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500810:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500813:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 20 pid: 5797 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500830:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 20 pid: 5797 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500840:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500860:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3310:x1872116879227520:12345-0@lo:103: Request processed in 58us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500865:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785389958.500876:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785389958.500881:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879228032:12345-0@lo:103: 00010000:00010000:3.0:1785389958.500887:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389958.500891:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 19 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500898:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 19 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389958.500905:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389958.500922:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879228032:12345-0@lo:103: Request processed in 41us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389958.500926:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785389958.500973:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879227520:0@lo:103: 00000100:00100000:3.0:1785389958.500982:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879228032:0@lo:103: 00000100:00100000:3.0:1785389958.500989:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879227648:0@lo:103: 00000100:00100000:3.0:1785389958.500995:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879228160:0@lo:103: 00000100:00100000:3.0:1785389958.501023:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879227776:0@lo:103: 00000100:00100000:3.0:1785389958.501038:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879227392:0@lo:103: 00000100:00100000:3.0:1785389958.501044:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879227904:0@lo:103: 00010000:00010000:0.0:1785389958.501223:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5000/0x33dffe75ff5ecc09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecbfb expref: 18 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501234:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226496:0@lo:104: 00010000:00010000:0.0:1785389958.501245:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501528400/0x33dffe75ff5ecbdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecbd8 expref: 17 pid: 5797 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501253:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226624:0@lo:104: 00010000:00010000:0.0:1785389958.501272:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4400/0x33dffe75ff5ecbc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecbbc expref: 16 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501280:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226752:0@lo:104: 00010000:00010000:0.0:1785389958.501288:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5ecbb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecbae expref: 15 pid: 5798 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501296:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226880:0@lo:104: 00010000:00010000:0.0:1785389958.501304:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5200/0x33dffe75ff5ecba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecba0 expref: 14 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501311:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879227008:0@lo:104: 00010000:00010000:0.0:1785389958.501319:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecb7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecb76 expref: 13 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501327:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879227136:0@lo:104: 00010000:00010000:0.0:1785389958.501335:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5e00/0x33dffe75ff5ecb53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecb4c expref: 12 pid: 5795 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389958.501342:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879227264:0@lo:104: 00000100:00100000:2.0:1785389958.510898:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389958.510922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389958.510973:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743488 00000100:00100000:3.0:1785389958.510982:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743488 00010000:00010000:3.0:1785389958.511017:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 10 pid: 5797 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389958.511087:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743616 00000100:00100000:3.0:1785389958.511091:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743616 00010000:00010000:3.0:1785389958.511104:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 11 pid: 5795 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389958.516777:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1785389958.516797:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:2359:x1872116847743488:12345-192.168.202.54@tcp:103: 00010000:00010000:2.0:1785389958.516818:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785389958.516827:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 11 pid: 5797 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.516843:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 11 pid: 5797 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.516863:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785389958.516919:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:2359:x1872116847743488:12345-192.168.202.54@tcp:103: Request processed in 131us (6030us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389958.516944:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1785389958.516967:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:2.0:1785389958.516974:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2359:x1872116847743616:12345-192.168.202.54@tcp:103: 00010000:00010000:2.0:1785389958.516982:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785389958.516986:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 10 pid: 5795 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.516995:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 10 pid: 5795 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517008:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517015:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517029:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517036:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517042:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517048:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517054:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fc400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785389958.517058:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517072:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517082:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389958.517092:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785389958.517112:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2359:x1872116847743616:12345-192.168.202.54@tcp:103: Request processed in 139us (6189us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389958.517119:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:1.0:1785389958.517665:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecc1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be21 expref: 9 pid: 5797 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389958.517679:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226240:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785389958.517688:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be1a expref: 8 pid: 5795 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389958.517707:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1872116879226368:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785389958.517745:0:8312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389958.517754:0:8312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389958.517759:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389958.517765:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389958.618426:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389959.599856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389959.599906:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389959.599950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389959.599990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389959.600020:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744000 00000100:00100000:1.0:1785389959.600029:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744000 00000100:00100000:1.0:1785389959.600080:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744128 00000100:00100000:1.0:1785389959.600083:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744128 00000100:00100000:1.0:1785389959.600108:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1785389959.600118:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847744000:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1785389959.600186:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847744000:12345-192.168.202.54@tcp:400: Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389959.600193:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1785389959.600207:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1785389959.600228:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847744128:12345-192.168.202.54@tcp:400: 00000100:00100000:1.0:1785389959.600255:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847744128:12345-192.168.202.54@tcp:400: Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389959.600261:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00080000:1.0:1785389959.600276:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785389959.600280:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785389959.602129:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743872 00000100:00100000:2.0:1785389959.602138:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743872 00000100:00100000:2.0:1785389959.602216:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:2.0:1785389959.602226:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847743872:12345-192.168.202.54@tcp:400: 00000100:00100000:2.0:1785389959.602274:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847743872:12345-192.168.202.54@tcp:400: Request processed in 51us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389959.602280:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00080000:1.0:1785389959.602687:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785389959.610733:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847743744 00000100:00100000:3.0:1785389959.610747:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847743744 00000100:00100000:3.0:1785389959.610830:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:3.0:1785389959.610841:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+8:2359:x1872116847743744:12345-192.168.202.54@tcp:400: 00000100:00100000:3.0:1785389959.610922:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+8:2359:x1872116847743744:12345-192.168.202.54@tcp:400: Request processed in 83us (11014us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389959.610929:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00010000:00010000:3.0:1785389959.638559:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389959.793649:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389959.793744:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744256 00000100:00100000:0.0:1785389959.793765:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744256 00000100:00100000:0.0:1785389959.793813:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:0.0:1785389959.793821:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+8:5582:x1872116847744256:12345-192.168.202.54@tcp:101: 00010000:00010000:0.0:1785389959.793837:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389959.793861:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be83 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389959.793907:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be83 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389959.793916:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be83 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389959.793925:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fc400, rc 0) 00000100:00100000:0.0:1785389959.793987:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847744256:12345-192.168.202.54@tcp:101: Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389959.793993:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:1.0:1785389959.805226:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389959.805372:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744384 00000100:00100000:2.0:1785389959.805382:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744384 00000100:00100000:2.0:1785389959.805434:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:2.0:1785389959.805443:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847744384:12345-192.168.202.54@tcp:501: 00000100:00100000:2.0:1785389959.805766:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847744384:12345-192.168.202.54@tcp:501: Request processed in 323us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389959.805773:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:1.0:1785389959.816213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389959.816385:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744512 00000100:00100000:2.0:1785389959.816395:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744512 00000100:00100000:2.0:1785389959.816476:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:2.0:1785389959.816486:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847744512:12345-192.168.202.54@tcp:503: 00000100:00100000:2.0:1785389959.816760:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847744512:12345-192.168.202.54@tcp:503: Request processed in 275us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389959.816768:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:1.0:1785389959.822322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389959.822558:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744640 00000100:00100000:0.0:1785389959.822567:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744640 00000100:00100000:0.0:1785389959.822624:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:0.0:1785389959.822634:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+9:6055:x1872116847744640:12345-192.168.202.54@tcp:502: 00000100:00100000:0.0:1785389959.822919:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+9:6055:x1872116847744640:12345-192.168.202.54@tcp:502: Request processed in 286us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389959.822926:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:3.0:1785389959.824811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389959.824935:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744768 00000100:00100000:1.0:1785389959.824952:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744768 00000100:00100000:1.0:1785389959.824994:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:1.0:1785389959.825003:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:6055:x1872116847744768:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785389959.825184:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:6055:x1872116847744768:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 183us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389959.825191:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:1.0:1785389959.828808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389959.830029:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847744896 00000100:00100000:2.0:1785389959.830041:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847744896 00000100:00100000:2.0:1785389959.830104:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:2.0:1785389959.830123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847744896:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785389959.830139:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389959.830155:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529000/0x33dffe75ff5ecc64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be8a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389959.830182:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529000/0x33dffe75ff5ecc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be8a expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389959.830208:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529000/0x33dffe75ff5ecc64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be8a expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389959.830216:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529000, rc 0) 00000100:00100000:2.0:1785389959.830267:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847744896:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 155us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389959.830274:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:2.0:1785389959.835620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389959.835756:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745024 00000100:00100000:1.0:1785389959.835765:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745024 00000100:00100000:1.0:1785389959.835811:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:1.0:1785389959.835819:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745024:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389959.836811:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745024:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 989us (1198us total) trans 0 rc -2/-2 00000100:00100000:1.0:1785389959.836819:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 144 10000000:01000000:3.0:1785389960.405640:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785389960.405649:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf53b946000 from 39 10000000:01000000:3.0:1785389960.405654:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785389960.405698:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.405710:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.405747:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389960.405768:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228288:0@lo:101: 00000100:00100000:3.0:1785389960.405836:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.405926:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.406094:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228288 00000100:00100000:0.0:1785389960.406100:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228288 00000100:00100000:0.0:1785389960.406170:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1785389960.406180:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+12:5800:x1872116879228288:12345-0@lo:101: 00010000:00010000:0.0:1785389960.406192:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389960.406204:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecc6b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.406238:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc6b expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.406254:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc6b expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.406262:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5013fd600, rc 0) 00000100:00100000:0.0:1785389960.406307:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879228288:12345-0@lo:101: Request processed in 129us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.406314:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1785389960.406450:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228288:0@lo:101: 00010000:00010000:3.0:1785389960.406474:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.406483:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389960.406553:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228416:0@lo:501: 00000100:00100000:3.0:1785389960.406576:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.406599:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.407435:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228416 00000100:00100000:1.0:1785389960.407440:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228416 00000100:00100000:1.0:1785389960.407475:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1785389960.407483:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879228416:12345-0@lo:501: 00000100:00100000:1.0:1785389960.407783:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879228416:12345-0@lo:501: Request processed in 301us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.407789:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1785389960.408027:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228416:0@lo:501: 00000100:00100000:3.0:1785389960.408054:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228544:0@lo:503: 00000100:00100000:3.0:1785389960.408117:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.408146:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.408205:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228544 00000100:00100000:2.0:1785389960.408212:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228544 00000100:00100000:2.0:1785389960.408241:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1785389960.408246:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879228544:12345-0@lo:503: 00000100:00100000:2.0:1785389960.408418:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879228544:12345-0@lo:503: Request processed in 171us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.408425:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1785389960.408575:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228544:0@lo:503: 00000100:00100000:3.0:1785389960.408988:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8336:1872116879228672:0@lo:502: 00000100:00100000:3.0:1785389960.409037:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.409066:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.409114:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228672 00000100:00100000:2.0:1785389960.409117:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228672 00000100:00100000:2.0:1785389960.409133:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1785389960.409138:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:8336:x1872116879228672:12345-0@lo:502: 00000100:00100000:2.0:1785389960.409286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:8336:x1872116879228672:12345-0@lo:502: Request processed in 147us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.409292:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1785389960.409562:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8336:1872116879228672:0@lo:502: 00000100:00100000:3.0:1785389960.409601:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8336:1872116879228800:0@lo:502: 00000100:00100000:3.0:1785389960.409633:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.409659:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.409924:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228800 00000100:00100000:0.0:1785389960.409934:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228800 00000100:00100000:0.0:1785389960.409950:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1785389960.409955:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:8336:x1872116879228800:12345-0@lo:502: 00000100:00100000:0.0:1785389960.410086:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:8336:x1872116879228800:12345-0@lo:502: Request processed in 129us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.410093:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1785389960.410174:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8336:1872116879228800:0@lo:502: 00000040:00080000:3.0:1785389960.410192:0:8336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1785389960.410585:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1785389960.410608:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785389960.410616:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.410627:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389960.410635:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1785389960.410638:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1785389960.410640:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1785389960.410662:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.410680:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.410689:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.410701:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228928:0@lo:101: 00000100:00100000:0.0:1785389960.410729:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.410752:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389960.410813:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879228928 00000100:00100000:3.0:1785389960.410818:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879228928 00000100:00100000:3.0:1785389960.410847:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1785389960.410854:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+13:5800:x1872116879228928:12345-0@lo:101: 00010000:00010000:3.0:1785389960.410862:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389960.410873:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5ecc80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecc79 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.410891:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5ecc80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc79 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.410901:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5ecc80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc79 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.410909:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4000, rc 0) 00000100:00100000:3.0:1785389960.410935:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879228928:12345-0@lo:101: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389960.410940:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1785389960.411072:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879228928:0@lo:101: 00010000:00010000:0.0:1785389960.411084:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.411092:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.411135:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229056:0@lo:501: 00000100:00100000:0.0:1785389960.411159:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.411181:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.411222:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229056 00000100:00100000:1.0:1785389960.411226:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229056 00000100:00100000:1.0:1785389960.411256:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1785389960.411262:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879229056:12345-0@lo:501: 00000100:00100000:1.0:1785389960.411466:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879229056:12345-0@lo:501: Request processed in 204us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.411473:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1785389960.411619:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229056:0@lo:501: 00000100:00100000:0.0:1785389960.411641:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229184:0@lo:503: 00000100:00100000:0.0:1785389960.411673:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.411697:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.411745:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229184 00000100:00100000:2.0:1785389960.411749:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229184 00000100:00100000:2.0:1785389960.411798:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1785389960.411804:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879229184:12345-0@lo:503: 00000100:00100000:2.0:1785389960.411929:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:5800:x1872116879229184:12345-0@lo:503: Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.411936:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1785389960.412032:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229184:0@lo:503: 00000100:00100000:0.0:1785389960.412399:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8337:1872116879229312:0@lo:502: 00000100:00100000:0.0:1785389960.412437:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.412568:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229312 00000100:00100000:2.0:1785389960.412573:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229312 00000100:00100000:2.0:1785389960.412596:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1785389960.412602:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:8337:x1872116879229312:12345-0@lo:502: 00000100:00100000:3.0:1785389960.423122:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:8337:x1872116879229312:12345-0@lo:502: Request processed in 10511us (10675us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389960.423137:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1785389960.423281:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.423308:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8337:1872116879229312:0@lo:502: 00000020:01000000:0.0:1785389960.423593:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785389960.423604:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389960.423606:0:8337:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785389960.423613:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1785389960.423651:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8337:1872116879229440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.423703:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.423731:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.425149:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229440 00000100:00100000:2.0:1785389960.425157:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229440 00000100:00100000:2.0:1785389960.425211:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785389960.425219:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:8337:x1872116879229440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.425710:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8337:1872116879229440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785389960.425737:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785389960.425743:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785389960.425745:0:8337:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785389960.425749:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1785389960.425925:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1785389960.425945:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1785389960.425960:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.425972:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785389960.425982:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1785389960.425984:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf5111bb800 from 39 10000000:01000000:3.0:1785389960.425986:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785389960.426011:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.426019:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.426028:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389960.426042:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785389960.430192:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.430240:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.430550:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229568 00000100:00100000:1.0:1785389960.430558:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229568 00000100:00100000:1.0:1785389960.430607:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1785389960.430616:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:5800:x1872116879229568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785389960.430632:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785389960.430648:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f5000/0x33dffe75ff5ecc8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecc87 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.430676:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f5000/0x33dffe75ff5ecc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc87 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.430687:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f5000/0x33dffe75ff5ecc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc87 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.430694:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5000, rc 0) 00000100:00100000:1.0:1785389960.430747:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879229568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.430753:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1785389960.430801:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785389960.430815:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.430823:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389960.430879:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.430917:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389960.430933:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.430942:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229696 00000100:00100000:1.0:1785389960.430944:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229696 00000100:00100000:1.0:1785389960.430957:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1785389960.430961:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879229696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.431178:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879229696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.431186:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1785389960.431213:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.431238:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.431275:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389960.431288:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.431298:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229824 00000100:00100000:1.0:1785389960.431301:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229824 00000100:00100000:1.0:1785389960.431323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1785389960.431328:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879229824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.431491:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879229824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.431497:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1785389960.431552:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879229824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.440809:0:8340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8340:1872116879229952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.440912:0:8340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.440946:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879229952 00000100:00100000:0.0:1785389960.440953:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879229952 00000100:00100000:0.0:1785389960.440987:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1785389960.440994:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8340:x1872116879229952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.441302:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8340:x1872116879229952:12345-0@lo:502:llog_process_th.0 Request processed in 307us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.441309:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1785389960.441408:0:8340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15180 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.441481:0:8340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8340:1872116879229952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.441572:0:8340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8340:1872116879230080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.441630:0:8340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.441647:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230080 00000100:00100000:0.0:1785389960.441650:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230080 00000100:00100000:0.0:1785389960.441664:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1785389960.441669:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8340:x1872116879230080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.441805:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8340:x1872116879230080:12345-0@lo:502:llog_process_th.0 Request processed in 135us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.441810:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1785389960.441832:0:8340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15180 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.441872:0:8340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8340:1872116879230080:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1785389960.441887:0:8340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1785389960.441958:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1785389960.441971:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785389960.441980:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.441990:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389960.441997:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1785389960.442000:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1785389960.442002:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1785389960.442033:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.442040:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.442052:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.442063:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.442116:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.442127:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.442137:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230208 00000100:00100000:0.0:1785389960.442140:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230208 00000100:00100000:0.0:1785389960.442153:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1785389960.442158:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879230208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785389960.442165:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389960.442176:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716600/0x33dffe75ff5ecc9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecc95 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.442225:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716600/0x33dffe75ff5ecc9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc95 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.442233:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716600/0x33dffe75ff5ecc9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecc95 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.442240:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716600, rc 0) 00000100:00100000:0.0:1785389960.442278:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.442282:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1785389960.442324:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785389960.442333:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.442348:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.442397:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.442421:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.442433:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.442443:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230336 00000100:00100000:0.0:1785389960.442445:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230336 00000100:00100000:0.0:1785389960.442461:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1785389960.442466:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.442677:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.442683:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1785389960.442710:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.442731:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.442760:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.442777:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.442788:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230464 00000100:00100000:0.0:1785389960.442791:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230464 00000100:00100000:0.0:1785389960.442805:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1785389960.442811:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.442924:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.442931:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1785389960.442968:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.443928:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8337:x1872116879229440:12345-0@lo:502:llog_process_th.0 Request processed in 18707us (20221us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.443945:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1785389960.450631:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8341:1872116879230592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.450709:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.450781:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf541ccd540 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.462743:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230592 00000100:00100000:0.0:1785389960.462758:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230592 00000100:00100000:0.0:1785389960.462851:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1785389960.462862:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8341:x1872116879230592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.463155:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8341:x1872116879230592:12345-0@lo:502:llog_process_th.0 Request processed in 295us (12445us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.463163:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1785389960.474756:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8341:1872116879230592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785389960.474823:0:8341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785389960.474836:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785389960.474838:0:8341:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785389960.474843:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1785389960.474884:0:8341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8341:1872116879230720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785389960.474956:0:8341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389960.475001:0:8341:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e257cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389960.475290:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230720 00000100:00100000:3.0:1785389960.475297:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230720 00000100:00100000:3.0:1785389960.475347:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1785389960.475432:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8341:x1872116879230720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785389960.476829:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:8341:x1872116879230720:12345-0@lo:502:llog_process_th.0 Request processed in 1395us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389960.476838:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1785389960.480627:0:8341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8341:1872116879230720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389960.480668:0:8341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389960.480675:0:8341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389960.480677:0:8341:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1785389960.480685:0:8341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1785389960.481028:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1785389960.481046:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1785389960.481055:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.481067:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785389960.481077:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1785389960.481079:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf509225000 from 39 10000000:01000000:0.0:1785389960.481081:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785389960.481110:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.481117:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.481125:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.481142:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.481217:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.481259:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d900 going to sleep for 11 seconds 00000100:00100000:3.0:1785389960.481513:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230848 00000100:00100000:3.0:1785389960.481589:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230848 00000100:00100000:3.0:1785389960.481633:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1785389960.481643:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879230848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785389960.481658:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389960.481672:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5eccaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecca3 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.481695:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5eccaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecca3 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.481705:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5eccaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecca3 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.481714:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4600, rc 0) 00000100:00100000:3.0:1785389960.481754:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389960.481761:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1785389960.482733:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785389960.482748:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.482758:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.482805:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.482834:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.482856:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53039d900 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.482918:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879230976 00000100:00100000:2.0:1785389960.482923:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879230976 00000100:00100000:2.0:1785389960.483176:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1785389960.483183:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.484711:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879230976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1525us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.484720:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1785389960.485715:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879230976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785389960.485759:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785389960.485805:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389960.485836:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.485879:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231104 00000100:00100000:0.0:1785389960.485884:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231104 00000100:00100000:0.0:1785389960.485922:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1785389960.485930:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879231104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.486078:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879231104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.486085:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1785389960.486599:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.488709:0:8343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8343:1872116879231232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.488763:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.488800:0:8343:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdbaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.488882:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231232 00000100:00100000:0.0:1785389960.488889:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231232 00000100:00100000:0.0:1785389960.488931:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1785389960.488939:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8343:x1872116879231232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785389960.489132:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8343:x1872116879231232:12345-0@lo:502:llog_process_th.0 Request processed in 193us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.489140:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1785389960.491248:0:8343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8343:1872116879231232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.491309:0:8343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8343:1872116879231360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.491371:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.491404:0:8343:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdbaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.492162:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231360 00000100:00100000:1.0:1785389960.492169:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231360 00000100:00100000:1.0:1785389960.492216:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1785389960.492225:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8343:x1872116879231360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785389960.493473:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8343:x1872116879231360:12345-0@lo:502:llog_process_th.0 Request processed in 1246us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.493482:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1785389960.496677:0:8343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8343:1872116879231360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1785389960.496903:0:8343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1785389960.497171:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1785389960.497189:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1785389960.497200:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389960.497212:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389960.497223:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1785389960.497226:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1785389960.497229:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1785389960.497260:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389960.497269:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389960.497278:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389960.497297:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.497345:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.497395:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdbaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1785389960.497434:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231488 00000100:00100000:3.0:1785389960.497440:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231488 00000100:00100000:3.0:1785389960.497494:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1785389960.497504:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879231488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785389960.497565:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389960.497579:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5eccb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eccb1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.497602:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5eccb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eccb1 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.497613:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5eccb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eccb1 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389960.497622:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4a00, rc 0) 00000100:00100000:3.0:1785389960.497658:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879231488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389960.497665:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1785389960.498240:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785389960.498252:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389960.498260:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389960.498321:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.498368:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.498422:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdbaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.505814:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231616 00000100:00100000:1.0:1785389960.505831:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231616 00000100:00100000:1.0:1785389960.515615:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1785389960.515629:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879231616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.515907:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879231616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (17537us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.515920:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1785389960.516383:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.516433:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.516487:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.516515:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdbaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.517733:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231744 00000100:00100000:2.0:1785389960.517740:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231744 00000100:00100000:2.0:1785389960.517769:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1785389960.517775:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879231744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.517936:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879231744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.517942:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1785389960.517990:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879231744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389960.520208:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8345:1872116879231872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.520264:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.520292:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879231872 00000100:00100000:2.0:1785389960.520297:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879231872 00000100:00100000:2.0:1785389960.520332:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1785389960.520340:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8345:x1872116879231872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.521814:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8345:x1872116879231872:12345-0@lo:502:llog_process_th.0 Request processed in 1473us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389960.521832:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1785389960.521880:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdba240 going to sleep for 11 seconds 00000100:00100000:2.0:1785389960.521898:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8345:1872116879231872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389960.521923:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389960.521933:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389960.521935:0:8345:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1785389960.521943:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1785389960.521965:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8345:1872116879232000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389960.521997:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389960.522011:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdba240 going to sleep for 11 seconds 00000100:00100000:1.0:1785389960.522203:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232000 00000100:00100000:1.0:1785389960.522208:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232000 00000100:00100000:1.0:1785389960.522242:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1785389960.522249:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8345:x1872116879232000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785389960.522388:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8345:x1872116879232000:12345-0@lo:502:llog_process_th.0 Request processed in 139us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389960.522395:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1785389960.525791:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8345:1872116879232000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389960.525833:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389960.525840:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389960.525842:0:8345:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1785389960.525849:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1785389960.526280:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1785389960.526301:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785389960.526311:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.526322:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389960.526333:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1785389960.526337:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf50ddfb380 from 1 10000000:01000000:1.0:1785389960.526340:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785389960.526384:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.526393:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389960.526401:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389960.526421:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879232128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785389960.526479:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389960.526517:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50e2579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.526710:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232128 00000100:00100000:0.0:1785389960.526716:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232128 00000100:00100000:0.0:1785389960.526759:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1785389960.526767:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879232128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785389960.526788:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785389960.526802:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5eccc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eccbf expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.526847:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5eccc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eccbf expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.526856:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5eccc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eccbf expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.526862:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716e00, rc 0) 00000100:00100000:0.0:1785389960.526897:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879232128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389960.526903:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1785389960.526936:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879232128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785389960.526946:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.526955:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389960.526993:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879232256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.527015:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389960.527031:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785389960.527046:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232256 00000100:00100000:0.0:1785389960.527049:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232256 00000100:00100000:0.0:1785389960.527174:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1785389960.527185:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879232256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785389960.527390:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879232256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785389960.527398:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1785389960.527431:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879232256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1785389960.527460:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1785389960.527465:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.527472:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389960.661781:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785389961.090306:0:8370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed4d47ea0 20000000:00000080:0.0:1785389961.090323:0:8370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf53f7b1000 uarg=0000000000000000 20000000:01000000:0.0:1785389961.090369:0:8370:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785389961.090375:0:8370:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785389961.090380:0:8370:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1785389961.091141:0:8371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1785389961.091265:0:8370:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1785389961.103161:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1785389961.103218:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1785389961.103277:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1785389961.103295:0:8370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1785389961.103314:0:8370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103355:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103364:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103372:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103381:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103390:0:8370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103429:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.103444:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 9 pid: 5797 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.103458:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232384:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785389961.104728:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.104739:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 18 pid: 5798 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.104750:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232512:0@lo:104: 00000100:00100000:0.0:1785389961.104797:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785389961.104909:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.104917:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 18 pid: 5795 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.104926:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232640:0@lo:104: 00000100:00100000:0.0:1785389961.104949:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389961.116858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389961.116930:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745152 00000100:00100000:3.0:1785389961.116939:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745152 00010000:00010000:3.0:1785389961.116978:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 10 pid: 5797 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389961.117018:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1785389961.117027:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847745152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785389961.117057:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785389961.117063:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 10 pid: 5797 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389961.117074:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 10 pid: 5797 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389961.117094:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785389961.117157:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847745152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 130us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389961.117164:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00010000:00010000:0.0:1785389961.119974:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.119991:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 18 pid: 5797 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.120003:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232768:0@lo:104: 00000100:00100000:0.0:1785389961.120040:0:8370:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1785389961.120090:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fc800/0x33dffe75ff5ecc2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be52 expref: 9 pid: 5797 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.120103:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232384:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785389961.120220:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1785389961.120256:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389961.120267:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232512 00000100:00100000:1.0:1785389961.120272:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232512 00000100:00100000:1.0:1785389961.120300:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232640 00000100:00100000:1.0:1785389961.120302:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232640 00000100:00100000:1.0:1785389961.120309:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232768 00000100:00100000:1.0:1785389961.120311:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232768 00000100:00100000:1.0:1785389961.120320:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785389961.120327:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:8370:x1872116879232512:12345-0@lo:104: 00010000:00010000:1.0:1785389961.120338:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120405:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1785389961.120411:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:8370:x1872116879232512:12345-0@lo:104: Request processed in 83us (15614us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389961.120417:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1785389961.120432:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785389961.120437:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:8370:x1872116879232640:12345-0@lo:104: 00010000:00010000:1.0:1785389961.120445:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120479:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1785389961.120485:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:8370:x1872116879232640:12345-0@lo:104: Request processed in 48us (15535us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389961.120490:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785389961.120558:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785389961.120565:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:8370:x1872116879232768:12345-0@lo:104: 00010000:00010000:1.0:1785389961.120572:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120599:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1785389961.120604:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:8370:x1872116879232768:12345-0@lo:104: Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389961.120610:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1785389961.120629:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1785389961.120634:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120640:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5600 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389961.120644:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120652:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389961.120659:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389961.120664:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785389961.120687:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120693:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785389961.120712:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120727:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5ecb68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecb6f expref: -99 pid: 7489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120738:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785389961.120741:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120746:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389961.120749:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120756:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389961.120762:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389961.120766:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785389961.120779:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120785:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785389961.120791:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120798:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4c00/0x33dffe75ff5eca9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecaa4 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120807:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785389961.120815:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120821:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500030800 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785389961.120824:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120831:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785389961.120837:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389961.120841:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785389961.120855:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120860:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785389961.120875:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120882:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500030800/0x33dffe75ff5eca3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eca42 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.120895:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389961.120897:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389961.120899:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389961.120909:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879232896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785389961.120938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389961.120961:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785389961.120967:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879233024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785389961.121004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389961.121027:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785389961.121034:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879233152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785389961.121053:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389961.121072:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879232896 00000100:00100000:1.0:1785389961.121076:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879232896 00010000:00010000:1.0:1785389961.121090:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 19 pid: 5798 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389961.121103:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233024 00000100:00100000:1.0:1785389961.121106:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233024 00010000:00010000:1.0:1785389961.121114:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 20 pid: 5795 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389961.121123:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233152 00000100:00100000:1.0:1785389961.121125:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233152 00010000:00010000:1.0:1785389961.121132:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 21 pid: 5797 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389961.121143:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785389961.121149:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+21:3307:x1872116879232896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785389961.121157:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785389961.121163:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 21 pid: 5798 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121174:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 21 pid: 5798 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121188:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785389961.121214:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+21:3307:x1872116879232896:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389961.121226:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785389961.121238:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785389961.121244:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3307:x1872116879233024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785389961.121251:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785389961.121256:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 20 pid: 5795 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121263:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 20 pid: 5795 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121274:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785389961.121294:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3307:x1872116879233024:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389961.121301:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785389961.121311:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785389961.121316:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879233152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785389961.121323:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785389961.121327:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 19 pid: 5797 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121336:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 19 pid: 5797 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121360:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121369:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121391:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121398:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121405:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121412:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121417:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785389961.121421:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121428:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121435:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389961.121444:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785389961.121468:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879233152:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389961.121474:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785389961.121498:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879233024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785389961.121505:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879232896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785389961.121552:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879233152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785389961.122585:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389961.122769:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf500031400/0x33dffe75ff5ecb6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecb68 expref: 18 pid: 5798 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.122781:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232512:0@lo:104: 00010000:00010000:0.0:1785389961.122792:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fcc00/0x33dffe75ff5ecaa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eca9d expref: 17 pid: 5795 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.122803:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232640:0@lo:104: 00010000:00010000:0.0:1785389961.122821:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fd400/0x33dffe75ff5eca42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eca3b expref: 16 pid: 5797 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785389961.122830:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1872116879232768:0@lo:104: 00010000:00010000:0.0:1785389961.122851:0:8370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.122860:0:8370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.122866:0:8370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785389961.122872:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503717600/0x33dffe75ff5ecccd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389961.123683:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:1.0:1785389961.685855:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389962.263639:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785389962.263660:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879233280:0@lo:400:kworker.0 00000100:00100000:2.0:1785389962.263660:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879233408:0@lo:400:kworker.0 00000100:00100000:3.0:1785389962.267659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389962.267659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389962.267733:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233280 00000100:00100000:0.0:1785389962.267743:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233280 00000100:00100000:0.0:1785389962.267796:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1785389962.267806:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3309:x1872116879233280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389962.267864:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3309:x1872116879233280:12345-0@lo:400:kworker.0 Request processed in 59us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389962.267872:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1785389962.267907:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879233280:0@lo:400:kworker.0 00000100:00100000:0.0:1785389962.268520:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389962.269224:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879233664:0@lo:400:kworker.0 00000100:00100000:2.0:1785389962.269261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389962.269307:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879233792:0@lo:400:kworker.0 00000100:00100000:2.0:1785389962.269329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389962.270816:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879233920:0@lo:400:kworker.0 00000100:00100000:0.0:1785389962.270854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389962.270874:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879233536:0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.271043:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233408 00000100:00100000:1.0:1785389962.271050:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233408 00000100:00100000:1.0:1785389962.271084:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233792 00000100:00100000:1.0:1785389962.271087:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233792 00000100:00100000:1.0:1785389962.271125:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785389962.271133:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.271179:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879233408:12345-0@lo:400:kworker.0 Request processed in 47us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389962.271186:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785389962.271200:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785389962.271206:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879233792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.271232:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879233792:12345-0@lo:400:kworker.0 Request processed in 26us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389962.271238:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785389962.271254:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233664 00000100:00100000:1.0:1785389962.271257:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233664 00000100:00100000:1.0:1785389962.271276:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233920 00000100:00100000:1.0:1785389962.271278:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233920 00000100:00100000:1.0:1785389962.271294:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785389962.271299:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879233664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.271325:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879233664:12345-0@lo:400:kworker.0 Request processed in 26us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389962.271330:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785389962.271354:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785389962.271360:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879233920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.271384:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879233920:12345-0@lo:400:kworker.0 Request processed in 24us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389962.271398:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1785389962.271425:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785389962.271429:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785389962.271431:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389962.271459:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879233792:0@lo:400:kworker.0 00010000:00080000:2.0:1785389962.275773:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc33480 x1872116879233664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389962.275810:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879233664:0@lo:400:kworker.0 00000100:00100000:2.0:1785389962.275847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389962.275888:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879233408:0@lo:400:kworker.0 00010000:00080000:2.0:1785389962.275906:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10ca80 x1872116879233920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389962.275914:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879233920:0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.275975:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879233536 00000100:00100000:1.0:1785389962.275982:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879233536 00000100:00100000:1.0:1785389962.276037:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785389962.276045:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879233536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389962.276128:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879233536:12345-0@lo:400:kworker.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389962.276136:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1785389962.276170:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879233536:0@lo:400:kworker.0 00000100:00080000:2.0:1785389962.276269:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389962.349584:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389962.349769:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745280 00000100:00100000:3.0:1785389962.349779:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745280 00000100:00100000:3.0:1785389962.349835:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:3.0:1785389962.349844:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+9:5582:x1872116847745280:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785389962.349862:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389962.349879:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be91 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389962.349906:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389962.349917:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389962.349927:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4e00, rc 0) 00000100:00100000:3.0:1785389962.349980:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745280:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 137us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389962.349987:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:3.0:1785389962.361778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389962.361865:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745408 00000100:00100000:2.0:1785389962.361875:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745408 00000100:00100000:2.0:1785389962.361926:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:2.0:1785389962.361934:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745408:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389962.362212:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745408:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 277us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389962.362220:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:3.0:1785389962.365764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389962.365827:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745536 00000100:00100000:0.0:1785389962.365847:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745536 00000100:00100000:0.0:1785389962.365896:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:0.0:1785389962.365904:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745536:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785389962.366093:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:5582:x1872116847745536:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 189us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389962.366102:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:0.0:1785389962.369670:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389962.369751:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745664 00000100:00100000:2.0:1785389962.369761:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745664 00000100:00100000:2.0:1785389962.369813:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:2.0:1785389962.369863:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:6108:x1872116847745664:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785389962.370081:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:6108:x1872116847745664:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 220us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389962.373402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389962.373442:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745792 00000100:00100000:3.0:1785389962.373451:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745792 00000100:00100000:2.0:1785389962.380396:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:3.0:1785389962.384455:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:3.0:1785389962.384474:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:6108:x1872116847745792:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785389962.384746:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:6108:x1872116847745792:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 277us (11352us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389962.384755:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 182 00010000:00010000:3.0:1785389962.715485:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389962.774576:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785389962.774596:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879234048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785389962.774661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389962.774719:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234048 00000100:00100000:1.0:1785389962.774726:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234048 00000100:00100000:1.0:1785389962.774765:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785389962.774773:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879234048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785389962.774806:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389962.774846:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879234048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389962.774853:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1785389962.774889:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12680 x1872116879234048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389962.774915:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879234048:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1785389963.111390:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785389963.111396:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf53b946000 from 4 10000000:01000000:2.0:1785389963.111400:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785389963.111451:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.111462:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.111473:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389963.111497:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.111588:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.111621:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234176 00000100:00100000:2.0:1785389963.111628:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234176 00000100:00100000:2.0:1785389963.111670:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1785389963.111678:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879234176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785389963.111690:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785389963.111702:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eccdb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.111723:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.111732:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.111741:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529a00, rc 0) 00000100:00100000:2.0:1785389963.111768:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879234176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389963.111774:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1785389963.111833:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5356a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1785389963.111851:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785389963.111864:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.111872:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389963.111916:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.111938:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.111949:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389963.112291:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234304 00000100:00100000:3.0:1785389963.112296:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234304 00000100:00100000:3.0:1785389963.112637:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1785389963.112646:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879234304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785389963.112875:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879234304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389963.112883:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1785389963.112937:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.112964:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.113002:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389963.120934:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234432 00000100:00100000:1.0:1785389963.120948:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234432 00000100:00100000:1.0:1785389963.120992:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1785389963.121000:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879234432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.121204:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879234432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (8201us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.121211:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1785389963.121765:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389963.121790:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc30a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785389963.122090:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8436:1872116879234560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785389963.122137:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389963.122161:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5118b80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785389963.122198:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234560 00000100:00100000:1.0:1785389963.122203:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234560 00000100:00100000:1.0:1785389963.122232:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1785389963.122238:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8436:x1872116879234560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785389963.122380:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8436:x1872116879234560:12345-0@lo:502:llog_process_th.0 Request processed in 142us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.122387:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1785389963.122453:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8436:1872116879234560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785389963.122473:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785389963.122483:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389963.122490:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1785389963.122500:0:8436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf53b946000 00000020:00000080:3.0:1785389963.122503:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1785389963.122598:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8436:1872116879234688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785389963.122628:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389963.122639:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50946ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1785389963.124347:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234688 00000100:00100000:1.0:1785389963.124355:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234688 00000100:00100000:1.0:1785389963.124391:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1785389963.124399:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8436:x1872116879234688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785389963.124595:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:8436:x1872116879234688:12345-0@lo:502:llog_process_th.0 Request processed in 196us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.124602:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1785389963.126928:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8436:1872116879234688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1785389963.126971:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785389963.126978:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785389963.126980:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1785389963.126989:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1785389963.128647:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1785389963.128674:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785389963.128685:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.128703:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785389963.128714:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785389963.128716:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5111bb800 from 4 10000000:01000000:1.0:1785389963.128718:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785389963.128750:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.128758:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.128767:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389963.128790:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.128844:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389963.128878:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234816 00000100:00100000:1.0:1785389963.128884:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234816 00000100:00100000:1.0:1785389963.128920:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1785389963.128928:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879234816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785389963.128941:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785389963.128953:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecce9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.128974:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.128984:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.129000:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785389963.129030:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879234816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.129037:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1785389963.129074:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785389963.129088:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785389963.129100:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785389963.129109:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785389963.129155:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.129178:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389963.129195:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879234944 00000100:00100000:1.0:1785389963.129198:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879234944 00000100:00100000:1.0:1785389963.129214:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1785389963.129220:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879234944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.129425:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879234944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.129431:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1785389963.129451:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785389963.129461:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879234944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.129483:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.129552:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389963.129569:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235072 00000100:00100000:1.0:1785389963.129572:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235072 00000100:00100000:1.0:1785389963.129591:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1785389963.129597:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879235072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785389963.129719:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879235072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.129726:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1785389963.129758:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785389963.129770:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.132746:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8438:1872116879235200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.132812:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.132848:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785389963.132890:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235200 00000100:00100000:1.0:1785389963.132896:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235200 00000100:00100000:1.0:1785389963.132933:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1785389963.132941:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8438:x1872116879235200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785389963.133103:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8438:x1872116879235200:12345-0@lo:502:llog_process_th.0 Request processed in 161us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389963.133111:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1785389963.133188:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8438:1872116879235200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389963.133212:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389963.133220:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389963.133222:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1785389963.133228:0:8438:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf5111bb800 00000020:00000080:2.0:1785389963.133231:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1785389963.133308:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8438:1872116879235328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.133353:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.133372:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235328 00000100:00100000:2.0:1785389963.133381:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235328 00000100:00100000:2.0:1785389963.133401:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1785389963.133406:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8438:x1872116879235328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.133504:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:8438:x1872116879235328:12345-0@lo:502:llog_process_th.0 Request processed in 97us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389963.133510:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1785389963.133958:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785389963.133971:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8438:1872116879235328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389963.133987:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389963.133991:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389963.133993:0:8438:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1785389963.133996:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1785389963.137900:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1785389963.137927:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785389963.137938:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.137951:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785389963.137961:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785389963.137963:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf509225000 from 4 10000000:01000000:2.0:1785389963.137966:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785389963.137997:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.138005:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.138015:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389963.138046:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.138102:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.138141:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389963.138186:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235456 00000100:00100000:3.0:1785389963.138192:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235456 00000100:00100000:3.0:1785389963.138229:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1785389963.138237:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879235456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785389963.138248:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785389963.138260:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eccf7 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389963.138281:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389963.138290:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785389963.138298:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4800, rc 0) 00000100:00100000:3.0:1785389963.138350:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879235456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389963.138357:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1785389963.138431:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785389963.138443:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.138451:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785389963.138491:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.138514:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.138554:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389963.138646:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235584 00000100:00100000:3.0:1785389963.138651:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235584 00000100:00100000:3.0:1785389963.138678:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1785389963.138685:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879235584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785389963.138894:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879235584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389963.138901:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1785389963.138968:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.138993:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.139027:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.139042:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785389963.139091:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235712 00000100:00100000:3.0:1785389963.139095:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235712 00000100:00100000:3.0:1785389963.139116:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1785389963.139122:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879235712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785389963.139239:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879235712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389963.139246:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1785389963.139486:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879235712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785389963.140672:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8439:1872116879235840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.140717:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.140753:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235840 00000100:00100000:2.0:1785389963.140758:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235840 00000100:00100000:2.0:1785389963.140789:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1785389963.140796:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:8439:x1872116879235840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.140940:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:8439:x1872116879235840:12345-0@lo:502:llog_process_th.0 Request processed in 144us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389963.140952:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1785389963.140993:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15000 going to sleep for 11 seconds 00000100:00100000:2.0:1785389963.141009:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8439:1872116879235840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389963.141033:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785389963.141042:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389963.141044:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1785389963.141050:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf509225000 00000020:00000080:2.0:1785389963.141052:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1785389963.141117:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8439:1872116879235968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.141148:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389963.141167:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879235968 00000100:00100000:2.0:1785389963.141170:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879235968 00000100:00100000:2.0:1785389963.141188:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1785389963.141193:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:8439:x1872116879235968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785389963.141284:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:8439:x1872116879235968:12345-0@lo:502:llog_process_th.0 Request processed in 90us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389963.141291:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1785389963.141316:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15000 going to sleep for 11 seconds 00000100:00100000:2.0:1785389963.141340:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:8439:1872116879235968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785389963.141365:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785389963.141368:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785389963.141370:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1785389963.141373:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1785389963.141408:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1785389963.141426:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785389963.141434:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785389963.141445:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785389963.287125:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879236096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785389963.287195:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389963.287262:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236096 00000100:00100000:3.0:1785389963.287269:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236096 00000100:00100000:3.0:1785389963.287310:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785389963.287318:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879236096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785389963.287360:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785389963.287399:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879236096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389963.287405:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1785389963.287443:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10d880 x1872116879236096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389963.287478:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879236096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785389963.754452:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389964.759778:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389964.772422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389964.772759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389964.772785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389964.772807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389964.773201:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847745920 00000100:00100000:0.0:1785389964.773218:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847745920 00000100:00100000:0.0:1785389964.773289:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:0.0:1785389964.773300:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847745920:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785389964.773394:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847745920:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 96us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389964.773402:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:1.0:1785389964.773764:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746176 00000100:00100000:1.0:1785389964.773769:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746176 00000100:00100000:1.0:1785389964.773817:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746304 00000100:00100000:1.0:1785389964.773821:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746304 00000100:00100000:1.0:1785389964.773841:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785389964.773847:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847746176:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389964.773900:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847746176:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 46us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389964.773920:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785389964.773934:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1785389964.773941:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847746304:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389964.774084:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847746304:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 143us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389964.774092:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1785389964.774179:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746048 00000100:00100000:1.0:1785389964.774183:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746048 00000100:00100000:1.0:1785389964.774217:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1785389964.774224:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847746048:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389964.774255:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847746048:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 32us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389964.774261:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00080000:1.0:1785389964.774282:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785389964.774286:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785389964.774288:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785389965.790190:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785389966.805744:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389967.381843:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879236224:0@lo:400:kworker.0 00000100:00100000:3.0:1785389967.381885:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879236608:0@lo:400:kworker.0 00000100:00100000:3.0:1785389967.389245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389967.389362:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785389967.389800:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879236736:0@lo:400:kworker.0 00000100:00100000:3.0:1785389967.389869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389967.389911:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879236352:0@lo:400:kworker.0 00000100:00100000:3.0:1785389967.389935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389967.389951:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879236864:0@lo:400:kworker.0 00000100:00100000:3.0:1785389967.389970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389967.389994:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785389967.390000:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879236480:0@lo:400:kworker.0 00000100:00100000:3.0:1785389967.390017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389967.402213:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389967.402319:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236608 00000100:00100000:1.0:1785389967.402330:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236608 00000100:00100000:1.0:1785389967.402420:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236864 00000100:00100000:1.0:1785389967.402424:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236864 00000100:00100000:1.0:1785389967.402449:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785389967.402461:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879236608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389967.402595:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879236608:12345-0@lo:400:kworker.0 Request processed in 136us (13359us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389967.402622:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785389967.402642:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785389967.402648:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879236864:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1785389967.402817:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785389967.402823:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785389967.402886:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236224 00000100:00100000:2.0:1785389967.402891:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236224 00000100:00100000:2.0:1785389967.402925:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1785389967.402933:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879236224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389967.402971:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879236224:12345-0@lo:400:kworker.0 Request processed in 40us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389967.402978:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1785389967.403112:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879236864:12345-0@lo:400:kworker.0 Request processed in 41us (12718us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389967.403121:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785389967.403144:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236736 00000100:00100000:1.0:1785389967.403148:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236736 00000100:00100000:1.0:1785389967.403930:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236352 00000100:00100000:1.0:1785389967.403935:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236352 00000100:00100000:1.0:1785389967.403946:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236480 00000100:00100000:1.0:1785389967.403949:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236480 00000100:00100000:2.0:1785389967.404013:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785389967.404036:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879236736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389967.404081:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879236736:12345-0@lo:400:kworker.0 Request processed in 61us (14212us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389967.404087:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785389967.404102:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785389967.404108:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879236352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389967.404141:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879236352:12345-0@lo:400:kworker.0 Request processed in 33us (14204us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389967.404147:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1785389967.416560:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785389967.419200:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879236224:0@lo:400:kworker.0 00000100:00100000:1.0:1785389967.419490:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879236736:0@lo:400:kworker.0 00010000:00080000:1.0:1785389967.419510:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10e300 x1872116879236608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389967.419550:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879236608:0@lo:400:kworker.0 00000100:00100000:1.0:1785389967.419591:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879236352:0@lo:400:kworker.0 00010000:00080000:1.0:1785389967.419608:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10ce00 x1872116879236864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389967.419618:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879236864:0@lo:400:kworker.0 00000100:00100000:1.0:1785389967.419749:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785389967.419764:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879236480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389967.419882:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879236480:12345-0@lo:400:kworker.0 Request processed in 113us (29853us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389967.419900:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785389967.419938:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879236480:0@lo:400:kworker.0 00010000:00010000:1.0:1785389967.857361:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389967.897382:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389967.897413:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879236992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785389967.897564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389967.898257:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879236992 00000100:00100000:1.0:1785389967.898268:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879236992 00000100:00100000:1.0:1785389967.898347:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785389967.898356:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879236992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785389967.898399:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389967.898454:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879236992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389967.898461:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1785389967.899413:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12680 x1872116879236992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389967.899437:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879236992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785389968.414911:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785389968.414939:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879237120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785389968.415008:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389968.420664:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237120 00000100:00100000:1.0:1785389968.420687:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237120 00000100:00100000:1.0:1785389968.420778:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1785389968.420790:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879237120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785389968.420844:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389968.421645:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879237120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 850us (6628us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389968.421654:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1785389968.421727:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc31c00 x1872116879237120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389968.421842:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879237120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785389968.854614:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389969.842334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389969.842384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389969.842414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389969.842435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389969.842468:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746560 00000100:00100000:3.0:1785389969.842476:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746560 00000100:00100000:3.0:1785389969.842571:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1785389969.842582:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847746560:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785389969.842651:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847746560:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 71us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389969.842658:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1785389969.842681:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746688 00000100:00100000:3.0:1785389969.842685:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746688 00000100:00100000:3.0:1785389969.842706:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746816 00000100:00100000:3.0:1785389969.842709:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746816 00000100:00100000:3.0:1785389969.842725:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1785389969.842731:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2356:x1872116847746688:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:3.0:1785389969.842757:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecc3a 00000100:00080000:3.0:1785389969.842765:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785389969.842993:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1785389969.843311:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+2:2356:x1872116847746688:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 577us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389969.843319:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1785389969.843332:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1785389969.843339:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2356:x1872116847746816:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:3.0:1785389969.843351:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecc41 00000100:00080000:3.0:1785389969.843358:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8cf50e0b4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785389969.843393:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1785389969.843605:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+2:2356:x1872116847746816:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 265us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389969.843612:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00080000:3.0:1785389969.843630:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785389969.843634:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785389969.843636:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785389969.843764:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389969.844218:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746432 00000100:00100000:1.0:1785389969.844224:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746432 00000100:00100000:1.0:1785389969.844282:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1785389969.844299:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847746432:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389969.844340:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847746432:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 43us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389969.844348:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00010000:00010000:1.0:1785389969.844383:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389969.877786:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389970.901811:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785389971.052209:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:0.0:1785389971.052221:0:6622:0:(genops.c:906:class_export_put()) final put ffff8cf51f0e3800/db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:2.0:1785389971.052727:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf51f0e3800/db9e37b8-1bb4-4113-a95f-cdba66461e5f for lustre-OST0000 00000020:00000080:2.0:1785389971.052780:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf51f0e6800 for lustre-OST0000 00000001:02000400:2.0:1785389971.866118:0:8672:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1785389971.927666:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389972.510724:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879237504:0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.510794:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389972.510848:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785389972.510854:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879237376:0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.510878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389972.510896:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879237888:0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.510921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389972.510957:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237504 00000100:00100000:0.0:1785389972.510970:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237504 00000100:00100000:0.0:1785389972.511030:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237376 00000100:00100000:0.0:1785389972.511034:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237376 00000100:00100000:0.0:1785389972.511054:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1785389972.511062:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879237504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.511108:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879237504:12345-0@lo:400:kworker.0 Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389972.511115:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1785389972.511131:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1785389972.511136:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879237376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.511159:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879237376:12345-0@lo:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389972.511165:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1785389972.511180:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237888 00000100:00100000:0.0:1785389972.511183:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237888 00000100:00100000:0.0:1785389972.511206:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785389972.511212:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879237888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.511237:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879237888:12345-0@lo:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389972.511255:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1785389972.511270:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785389972.511274:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785389972.511308:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879237376:0@lo:400:kworker.0 00010000:00080000:0.0:1785389972.511322:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535926d80 x1872116879237888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389972.511331:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879237888:0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.511362:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879237504:0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511432:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879237632:0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389972.511490:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1785389972.511496:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879237248:0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389972.511571:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879237760:0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511592:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389972.511620:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237248 00000100:00100000:2.0:1785389972.511624:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237248 00000100:00100000:2.0:1785389972.511653:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1785389972.511659:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879237248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511694:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879237248:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389972.511700:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1785389972.511746:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879237248:0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511761:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237760 00000100:00100000:2.0:1785389972.511764:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237760 00000100:00100000:2.0:1785389972.511798:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785389972.511804:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879237760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389972.511837:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879237760:12345-0@lo:400:kworker.0 Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389972.511843:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1785389972.511859:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389972.511876:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879237760:0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.511992:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879237632 00000100:00100000:0.0:1785389972.511996:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879237632 00000100:00100000:0.0:1785389972.512086:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785389972.512093:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879237632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389972.512125:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879237632:12345-0@lo:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389972.512131:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1785389972.512322:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785389972.512353:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535924a80 x1872116879237632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389972.512363:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879237632:0@lo:400:kworker.0 00010000:00010000:3.0:1785389972.968409:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389973.014004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785389973.014030:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879238016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785389973.014113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389973.014548:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238016 00000100:00100000:1.0:1785389973.014556:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238016 00000100:00100000:1.0:1785389973.014602:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785389973.014611:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879238016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785389973.014642:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389973.014683:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879238016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389973.014690:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1785389973.014923:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b13480 x1872116879238016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389973.014941:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879238016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785389973.534257:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785389973.534280:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879238144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785389973.534364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389973.534435:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238144 00000100:00100000:1.0:1785389973.534443:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238144 00000100:00100000:1.0:1785389973.534488:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785389973.534495:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879238144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785389973.534540:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389973.534581:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879238144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389973.534589:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1785389973.534624:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b10a80 x1872116879238144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389973.534649:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879238144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785389973.974132:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785389974.647877:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:3.0:1785389974.647885:0:7506:0:(genops.c:906:class_export_put()) final put ffff8cf50e0b0800/db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:1.0:1785389974.648869:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf50e0b0800/db9e37b8-1bb4-4113-a95f-cdba66461e5f for lustre-OST0001 00000020:00000080:3.0:1785389974.650390:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf50e0b4000 for lustre-OST0001 00000100:00100000:3.0:1785389974.968585:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389974.968662:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389974.968724:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847746944 00000100:00100000:0.0:1785389974.968734:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847746944 00000100:00100000:0.0:1785389974.968792:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:0.0:1785389974.968802:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847746944:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785389974.968867:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847746944:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389974.968874:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:0.0:1785389974.968906:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747072 00000100:00100000:0.0:1785389974.968910:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747072 00000100:00100000:0.0:1785389974.968945:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1785389974.968952:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847747072:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785389974.968982:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847747072:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389974.968988:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00080000:0.0:1785389974.969080:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785389975.004307:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389976.022628:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389977.046764:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389977.622928:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879238400:0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.622991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389977.623046:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879238912:0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389977.623093:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785389977.623097:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879238528:0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389977.623140:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238400 00000100:00100000:0.0:1785389977.623147:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238400 00000100:00100000:0.0:1785389977.623181:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238528 00000100:00100000:0.0:1785389977.623184:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238528 00000100:00100000:0.0:1785389977.623225:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1785389977.623234:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879238400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623287:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879238400:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389977.623293:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1785389977.623311:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785389977.623317:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879238528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623343:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879238528:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389977.623349:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785389977.623367:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238912 00000100:00100000:0.0:1785389977.623370:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238912 00000100:00100000:0.0:1785389977.623393:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785389977.623398:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879238912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623423:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879238912:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389977.623437:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1785389977.623457:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785389977.623462:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785389977.623492:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879238528:0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623500:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879238400:0@lo:400:kworker.0 00010000:00080000:0.0:1785389977.623511:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535925500 x1872116879238912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389977.623521:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879238912:0@lo:400:kworker.0 00000100:00100000:1.0:1785389977.623611:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879238272:0@lo:400:kworker.0 00000100:00100000:1.0:1785389977.623642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389977.623671:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879238784:0@lo:400:kworker.0 00000100:00100000:1.0:1785389977.623689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389977.623702:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785389977.623706:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879238656:0@lo:400:kworker.0 00000100:00100000:1.0:1785389977.623722:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389977.623779:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238272 00000100:00100000:0.0:1785389977.623783:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238272 00000100:00100000:0.0:1785389977.623814:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1785389977.623821:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879238272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623857:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879238272:12345-0@lo:400:kworker.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389977.623863:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1785389977.623889:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238656 00000100:00100000:0.0:1785389977.623892:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238656 00000100:00100000:0.0:1785389977.623916:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785389977.623921:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879238656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.623962:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879238656:12345-0@lo:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389977.623969:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1785389977.623985:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785389977.624001:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535925c00 x1872116879238656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389977.624024:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879238656:0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.624035:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879238272:0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.624051:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879238784 00000100:00100000:0.0:1785389977.624055:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879238784 00000100:00100000:0.0:1785389977.624080:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1785389977.624085:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879238784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389977.624118:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879238784:12345-0@lo:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389977.624123:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1785389977.624138:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785389977.624154:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879238784:0@lo:400:kworker.0 00010000:00010000:0.0:1785389978.080251:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785389978.145449:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879239040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785389978.145519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389978.145602:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239040 00000100:00100000:1.0:1785389978.145609:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239040 00000100:00100000:1.0:1785389978.145650:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785389978.145657:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879239040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785389978.145691:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389978.145730:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879239040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389978.145737:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1785389978.145789:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b11880 x1872116879239040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389978.145806:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879239040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785389978.657259:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879239168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785389978.657338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389978.661481:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239168 00000100:00100000:3.0:1785389978.661496:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239168 00000100:00100000:3.0:1785389978.661571:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785389978.661581:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879239168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785389978.661617:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785389978.661705:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879239168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389978.661712:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1785389978.661753:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc33800 x1872116879239168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389978.661772:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879239168:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1785389978.733390:0:8918:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing yml_node 00010000:00010000:0.0:1785389979.117502:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389980.079482:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389980.079580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389980.079606:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747328 00000100:00100000:0.0:1785389980.079615:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747328 00000100:00100000:0.0:1785389980.079671:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1785389980.079680:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847747328:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785389980.079747:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847747328:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389980.079755:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00080000:0.0:1785389980.079775:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389980.084646:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747200 00000100:00100000:2.0:1785389980.084660:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747200 00000100:00100000:2.0:1785389980.084716:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:2.0:1785389980.084726:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847747200:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785389980.084805:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847747200:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 81us (5332us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389980.084812:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00010000:00010000:1.0:1785389980.123037:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389981.145698:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389982.165938:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389982.741846:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785389982.741866:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879239424:0@lo:400:kworker.0 00000100:00100000:3.0:1785389982.741933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389982.742025:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879239552:0@lo:400:kworker.0 00000100:00100000:3.0:1785389982.742047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389982.742122:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785389982.742128:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879239936:0@lo:400:kworker.0 00000100:00100000:3.0:1785389982.742178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389982.742353:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879239680:0@lo:400:kworker.0 00000100:00100000:1.0:1785389982.742384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389982.742412:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785389982.742419:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879239296:0@lo:400:kworker.0 00000100:00100000:1.0:1785389982.742446:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389982.742467:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879239808:0@lo:400:kworker.0 00000100:00100000:1.0:1785389982.742487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389982.742514:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239296 00000100:00100000:1.0:1785389982.742552:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239296 00000100:00100000:1.0:1785389982.742594:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1785389982.742603:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879239296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785389982.742650:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879239296:12345-0@lo:400:kworker.0 Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389982.742658:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1785389982.742712:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879239296:0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.742934:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239424 00000100:00100000:0.0:1785389982.742947:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239424 00000100:00100000:0.0:1785389982.742983:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239552 00000100:00100000:0.0:1785389982.742987:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239552 00000100:00100000:0.0:1785389982.743008:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239808 00000100:00100000:0.0:1785389982.743011:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239808 00000100:00100000:0.0:1785389982.743025:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785389982.743031:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879239424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743071:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879239424:12345-0@lo:400:kworker.0 Request processed in 41us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389982.743078:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785389982.743092:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1785389982.743098:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879239552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743124:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879239552:12345-0@lo:400:kworker.0 Request processed in 26us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389982.743129:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1785389982.743139:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1785389982.743144:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879239808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743190:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879239808:12345-0@lo:400:kworker.0 Request processed in 45us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389982.743196:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1785389982.743217:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239936 00000100:00100000:0.0:1785389982.743220:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239936 00000100:00100000:0.0:1785389982.743243:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879239680 00000100:00100000:0.0:1785389982.743246:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879239680 00000100:00100000:0.0:1785389982.743262:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785389982.743268:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879239936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743298:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879239936:12345-0@lo:400:kworker.0 Request processed in 29us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389982.743312:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785389982.743324:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785389982.743330:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879239680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743372:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879239680:12345-0@lo:400:kworker.0 Request processed in 42us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389982.743378:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1785389982.743396:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785389982.743399:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785389982.743401:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785389982.743425:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879239808:0@lo:400:kworker.0 00010000:00080000:0.0:1785389982.743438:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a357800 x1872116879239680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389982.743449:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879239680:0@lo:400:kworker.0 00010000:00080000:0.0:1785389982.743477:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5182f8700 x1872116879239936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785389998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389982.743485:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879239936:0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743495:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879239552:0@lo:400:kworker.0 00000100:00100000:0.0:1785389982.743503:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879239424:0@lo:400:kworker.0 00010000:00010000:0.0:1785389983.189806:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389983.253765:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389983.253789:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879240064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785389983.253859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785389983.253996:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240064 00000100:00100000:3.0:1785389983.254005:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240064 00000100:00100000:3.0:1785389983.254051:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785389983.254060:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879240064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785389983.254094:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785389983.254183:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879240064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389983.254190:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1785389983.254385:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b10700 x1872116879240064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389983.254404:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879240064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785389983.765918:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879240192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785389983.765987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389983.766072:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240192 00000100:00100000:0.0:1785389983.766080:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240192 00000100:00100000:0.0:1785389983.766153:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785389983.766171:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879240192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785389983.766207:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785389983.766258:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879240192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389983.766264:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1785389983.766387:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fc33800 x1872116879240192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785389999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785389983.766406:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879240192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785389984.218124:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389985.202573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389985.202617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785389985.202805:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747584 00000100:00100000:1.0:1785389985.202815:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747584 00000100:00100000:1.0:1785389985.202870:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1785389985.202880:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847747584:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389985.202957:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847747584:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389985.202964:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00080000:1.0:1785389985.202982:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389985.203581:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747456 00000100:00100000:2.0:1785389985.203592:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747456 00000100:00100000:2.0:1785389985.203628:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:2.0:1785389985.203634:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847747456:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785389985.203673:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847747456:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 39us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389985.203687:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00010000:00010000:0.0:1785389985.237858:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389986.263111:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785389986.284739:0:9112:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.2 00010000:00010000:0.0:1785389987.289553:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389987.868748:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879240704:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.868818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389987.868870:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785389987.868876:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879240320:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.868905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389987.868927:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879240832:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.868986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389987.869015:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879240576:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389987.869057:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785389987.869063:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879240448:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389987.869100:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879240960:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389987.869166:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240704 00000100:00100000:0.0:1785389987.869178:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240704 00000100:00100000:0.0:1785389987.869227:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240960 00000100:00100000:0.0:1785389987.869230:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240960 00000100:00100000:0.0:1785389987.869251:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785389987.869259:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879240704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869306:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879240704:12345-0@lo:400:kworker.0 Request processed in 46us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389987.869312:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785389987.869328:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785389987.869335:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879240960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869364:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879240960:12345-0@lo:400:kworker.0 Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389987.869370:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785389987.869388:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240832 00000100:00100000:0.0:1785389987.869391:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240832 00000100:00100000:0.0:1785389987.869413:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240576 00000100:00100000:0.0:1785389987.869416:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240576 00000100:00100000:0.0:1785389987.869426:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240448 00000100:00100000:0.0:1785389987.869428:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240448 00000100:00100000:0.0:1785389987.869439:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785389987.869444:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879240832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869471:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879240832:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389987.869477:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1785389987.869487:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785389987.869492:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879240576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869553:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879240576:12345-0@lo:400:kworker.0 Request processed in 60us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389987.869567:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785389987.869579:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1785389987.869585:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879240448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869611:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879240448:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389987.869616:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1785389987.869638:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785389987.869642:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785389987.869644:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785389987.869669:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879240832:0@lo:400:kworker.0 00010000:00080000:0.0:1785389987.869680:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535925180 x1872116879240704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389987.869690:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879240704:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869713:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879240448:0@lo:400:kworker.0 00010000:00080000:0.0:1785389987.869721:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a355500 x1872116879240960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389987.869730:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879240960:0@lo:400:kworker.0 00000100:00100000:0.0:1785389987.869737:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879240576:0@lo:400:kworker.0 00000100:00100000:2.0:1785389987.870455:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879240320 00000100:00100000:2.0:1785389987.870461:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879240320 00000100:00100000:2.0:1785389987.870489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1785389987.870496:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879240320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389987.870561:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879240320:12345-0@lo:400:kworker.0 Request processed in 66us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389987.870568:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1785389987.870612:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879240320:0@lo:400:kworker.0 00010000:00010000:1.0:1785389988.310456:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389988.374535:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389988.374560:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879241088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785389988.374634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389988.374757:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241088 00000100:00100000:1.0:1785389988.374774:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241088 00000100:00100000:1.0:1785389988.374834:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1785389988.374844:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879241088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785389988.374879:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389988.374935:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879241088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389988.374942:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1785389988.375087:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12d80 x1872116879241088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389988.375115:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879241088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785389988.887135:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879241216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785389988.887206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389988.888396:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241216 00000100:00100000:1.0:1785389988.888417:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241216 00000100:00100000:1.0:1785389988.888470:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1785389988.888479:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879241216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785389988.888514:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389988.888608:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879241216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389988.888615:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1785389988.888798:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12300 x1872116879241216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389988.888817:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879241216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785389989.343948:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785389990.166588:0:9209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.2 00000100:00100000:0.0:1785389990.341741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785389990.342715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785389990.342837:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747840 00000100:00100000:2.0:1785389990.342857:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747840 00000100:00100000:2.0:1785389990.342929:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:2.0:1785389990.342943:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847747840:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785389990.343044:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847747840:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389990.343053:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00080000:0.0:1785389990.343678:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389990.351401:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747712 00000100:00100000:1.0:1785389990.351423:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747712 00000100:00100000:1.0:1785389990.351512:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:1.0:1785389990.351543:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847747712:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389990.352014:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847747712:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 490us (10283us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389990.352024:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00010000:00010000:0.0:1785389990.362482:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785389991.396873:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785389992.405792:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389992.982253:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879241728:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389992.982379:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785389992.982385:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879241344:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389992.982432:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879241856:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982453:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389992.982478:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879241472:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389992.982516:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879241984:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389992.982571:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785389992.982576:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879241600:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982597:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389992.982627:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241728 00000100:00100000:0.0:1785389992.982634:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241728 00000100:00100000:0.0:1785389992.982679:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241984 00000100:00100000:0.0:1785389992.982683:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241984 00000100:00100000:0.0:1785389992.982703:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785389992.982712:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879241728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982760:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879241728:12345-0@lo:400:kworker.0 Request processed in 49us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389992.982767:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785389992.982785:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785389992.982792:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879241984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982837:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879241984:12345-0@lo:400:kworker.0 Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389992.982851:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1785389992.982870:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241344 00000100:00100000:0.0:1785389992.982873:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241344 00000100:00100000:0.0:1785389992.982894:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1785389992.982900:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879241344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.982927:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879241344:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389992.982933:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1785389992.982955:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241856 00000100:00100000:0.0:1785389992.982958:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241856 00000100:00100000:0.0:1785389992.982979:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241472 00000100:00100000:0.0:1785389992.982981:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241472 00000100:00100000:0.0:1785389992.982990:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879241600 00000100:00100000:0.0:1785389992.982992:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879241600 00000100:00100000:0.0:1785389992.983003:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785389992.983008:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879241856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.983033:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879241856:12345-0@lo:400:kworker.0 Request processed in 25us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389992.983038:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785389992.983048:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785389992.983053:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879241472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.983087:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879241472:12345-0@lo:400:kworker.0 Request processed in 35us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389992.983093:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785389992.983103:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1785389992.983107:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879241600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.983138:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879241600:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389992.983144:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1785389992.983167:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785389992.983171:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785389992.983173:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785389992.983204:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879241600:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.983213:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879241472:0@lo:400:kworker.0 00010000:00080000:0.0:1785389992.983224:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e152680 x1872116879241984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389992.983233:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879241984:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.983256:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879241344:0@lo:400:kworker.0 00000100:00100000:0.0:1785389992.983266:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879241856:0@lo:400:kworker.0 00010000:00080000:0.0:1785389992.983275:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e151180 x1872116879241728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389992.983282:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879241728:0@lo:400:kworker.0 00010000:00010000:3.0:1785389993.429794:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785389993.496399:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879242112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785389993.496473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389993.496732:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242112 00000100:00100000:1.0:1785389993.496741:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242112 00000100:00100000:1.0:1785389993.496784:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1785389993.496793:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879242112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785389993.496826:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389993.496868:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879242112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389993.496876:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1785389993.497353:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b10380 x1872116879242112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389993.497375:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879242112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785389994.014193:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879242240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785389994.014269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785389994.014386:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242240 00000100:00100000:1.0:1785389994.014394:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242240 00000100:00100000:1.0:1785389994.014455:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785389994.014465:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879242240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785389994.014499:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785389994.014564:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879242240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389994.014571:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1785389994.014631:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785389994.014664:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b10e00 x1872116879242240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389994.014682:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879242240:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1785389994.085927:0:9307:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.2 00010000:00010000:0.0:1785389994.463715:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389995.437256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389995.437316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785389995.437346:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748096 00000100:00100000:3.0:1785389995.437355:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748096 00000100:00100000:3.0:1785389995.437413:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:3.0:1785389995.437423:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847748096:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785389995.437501:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847748096:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1785389995.437508:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00080000:3.0:1785389995.437550:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785389995.437716:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847747968 00000100:00100000:1.0:1785389995.437721:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847747968 00000100:00100000:1.0:1785389995.437761:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:1.0:1785389995.437768:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847747968:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785389995.437810:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847747968:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1785389995.437817:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00010000:00010000:3.0:1785389995.477747:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785389996.502710:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785389996.674162:0:9355:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Jul 30 01:39:54 EDT 2026 00010000:00010000:3.0:1785389997.526486:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785389998.102637:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879242496:0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.102701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389998.102749:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879243008:0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.102770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389998.102806:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785389998.102811:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879242624:0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.102829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389998.102858:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242496 00000100:00100000:2.0:1785389998.102865:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242496 00000100:00100000:2.0:1785389998.102901:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242624 00000100:00100000:2.0:1785389998.102903:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242624 00000100:00100000:2.0:1785389998.102925:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785389998.102932:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879242496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.102975:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879242496:12345-0@lo:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389998.102981:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785389998.103005:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785389998.103011:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879242624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.103068:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879242624:12345-0@lo:400:kworker.0 Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389998.103080:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1785389998.103101:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243008 00000100:00100000:2.0:1785389998.103105:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243008 00000100:00100000:2.0:1785389998.103131:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785389998.103137:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.103166:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879243008:12345-0@lo:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389998.103171:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1785389998.103195:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785389998.103198:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785389998.103226:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879242624:0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.103236:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879242496:0@lo:400:kworker.0 00010000:00080000:2.0:1785389998.103246:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e157b80 x1872116879243008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389998.103254:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879243008:0@lo:400:kworker.0 00000100:00100000:0.0:1785389998.103435:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879242368:0@lo:400:kworker.0 00000100:00100000:0.0:1785389998.103473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389998.103502:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879242880:0@lo:400:kworker.0 00000100:00100000:0.0:1785389998.103544:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389998.103560:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785389998.103565:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879242752:0@lo:400:kworker.0 00000100:00100000:0.0:1785389998.103585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785389998.103607:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242752 00000100:00100000:0.0:1785389998.103611:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242752 00000100:00100000:0.0:1785389998.103641:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1785389998.103646:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879242752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785389998.103679:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879242752:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1785389998.103685:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1785389998.103713:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e154000 x1872116879242752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785389998.103723:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879242752:0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.103895:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242368 00000100:00100000:2.0:1785389998.103899:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242368 00000100:00100000:2.0:1785389998.103931:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1785389998.103937:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879242368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.103972:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879242368:12345-0@lo:400:kworker.0 Request processed in 35us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389998.103977:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1785389998.104002:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879242880 00000100:00100000:2.0:1785389998.104005:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879242880 00000100:00100000:2.0:1785389998.104040:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1785389998.104055:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879242880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.104082:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879242880:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389998.104087:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1785389998.104102:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785389998.104104:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785389998.104119:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879242368:0@lo:400:kworker.0 00000100:00100000:2.0:1785389998.104129:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879242880:0@lo:400:kworker.0 00010000:00010000:0.0:1785389998.552145:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785389998.613991:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785389998.619949:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879243136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785389998.620035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389998.620152:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243136 00000100:00100000:2.0:1785389998.620160:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243136 00000100:00100000:2.0:1785389998.620215:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785389998.620225:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879243136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785389998.620270:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785389998.620316:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879243136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389998.620333:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1785389998.620579:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b13100 x1872116879243136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785389998.620599:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879243136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785389999.134388:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879243264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785389999.134449:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785389999.134623:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243264 00000100:00100000:2.0:1785389999.134630:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243264 00000100:00100000:2.0:1785389999.134675:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1785389999.134683:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879243264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785389999.134717:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785389999.134757:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879243264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1785389999.134764:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1785389999.134801:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b13100 x1872116879243264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785389999.134831:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879243264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785389999.574289:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390000.559353:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390000.559394:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390000.559421:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748224 00000100:00100000:1.0:1785390000.559430:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748224 00000100:00100000:1.0:1785390000.559474:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:1.0:1785390000.559482:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847748224:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390000.559565:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847748224:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 83us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390000.559574:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:3.0:1785390000.559775:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748352 00000100:00100000:3.0:1785390000.559780:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748352 00000100:00100000:3.0:1785390000.559814:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:3.0:1785390000.559821:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847748352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390000.559863:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847748352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390000.559881:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00080000:2.0:1785390000.561125:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785390000.597659:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390001.622309:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390002.645838:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390003.221704:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879243776:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.221777:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390003.221832:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1785390003.221838:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879243392:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.221883:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390003.221902:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879243904:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.221934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390003.221956:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879243520:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.221990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390003.222004:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879244032:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.222023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390003.222036:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390003.222040:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879243648:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.222078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390003.222114:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243776 00000100:00100000:0.0:1785390003.222121:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243776 00000100:00100000:0.0:1785390003.222173:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244032 00000100:00100000:0.0:1785390003.222176:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244032 00000100:00100000:0.0:1785390003.222200:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785390003.222209:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879243776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.222259:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879243776:12345-0@lo:400:kworker.0 Request processed in 50us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390003.222266:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785390003.222284:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785390003.222290:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879244032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.222334:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879244032:12345-0@lo:400:kworker.0 Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390003.222340:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785390003.222359:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243392 00000100:00100000:0.0:1785390003.222362:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243392 00000100:00100000:0.0:1785390003.222391:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1785390003.222899:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879243392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.222935:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879243392:12345-0@lo:400:kworker.0 Request processed in 539us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390003.222942:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1785390003.222983:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243904 00000100:00100000:0.0:1785390003.222987:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243904 00000100:00100000:0.0:1785390003.223050:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243520 00000100:00100000:0.0:1785390003.223053:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243520 00000100:00100000:2.0:1785390003.231992:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879243648 00000100:00100000:2.0:1785390003.232007:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879243648 00000100:00100000:2.0:1785390003.232072:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785390003.232082:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879243904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390003.232232:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879243904:12345-0@lo:400:kworker.0 Request processed in 149us (10294us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390003.232245:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1785390003.232279:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785390003.232299:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879243520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390003.232373:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879243520:12345-0@lo:400:kworker.0 Request processed in 89us (10383us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390003.232378:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1785390003.232387:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1785390003.232392:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879243648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390003.232417:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879243648:12345-0@lo:400:kworker.0 Request processed in 25us (10339us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390003.232423:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1785390003.232584:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390003.232590:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390003.232593:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390003.232821:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879243648:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.232834:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879243520:0@lo:400:kworker.0 00010000:00080000:0.0:1785390003.232848:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535925500 x1872116879244032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390003.232858:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879244032:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.232897:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879243392:0@lo:400:kworker.0 00000100:00100000:0.0:1785390003.232906:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879243904:0@lo:400:kworker.0 00010000:00080000:0.0:1785390003.232918:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e151c00 x1872116879243776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390003.232934:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879243776:0@lo:400:kworker.0 00010000:00010000:3.0:1785390003.669895:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390003.734665:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390003.734685:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879244160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390003.734748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390003.734799:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244160 00000100:00100000:1.0:1785390003.734806:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244160 00000100:00100000:1.0:1785390003.734841:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785390003.734848:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879244160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390003.734898:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390003.734934:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879244160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390003.734940:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1785390003.734991:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12300 x1872116879244160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390003.735007:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879244160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390004.247148:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390004.247179:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879244288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390004.247244:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390004.247318:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244288 00000100:00100000:3.0:1785390004.247326:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244288 00000100:00100000:3.0:1785390004.247372:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1785390004.247380:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879244288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390004.247427:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390004.247473:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879244288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390004.247481:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1785390004.247539:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5182fb100 x1872116879244288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390004.247557:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879244288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785390004.694005:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390005.688098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390005.688155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390005.688674:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748480 00000100:00100000:0.0:1785390005.688687:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748480 00000100:00100000:0.0:1785390005.688751:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:0.0:1785390005.688763:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847748480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390005.688854:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847748480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 93us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390005.688861:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:2.0:1785390005.693275:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748608 00000100:00100000:2.0:1785390005.693293:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748608 00000100:00100000:2.0:1785390005.693373:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:2.0:1785390005.693386:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847748608:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390005.693477:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847748608:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 95us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390005.693498:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00080000:0.0:1785390005.693716:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785390005.718511:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390006.742822:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390007.767697:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390008.344348:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879244544:0@lo:400:kworker.0 00000100:00100000:1.0:1785390008.344665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390008.344731:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879245056:0@lo:400:kworker.0 00000100:00100000:1.0:1785390008.344760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390008.344802:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390008.344808:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879244672:0@lo:400:kworker.0 00000100:00100000:1.0:1785390008.344828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390008.344857:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244544 00000100:00100000:1.0:1785390008.344865:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244544 00000100:00100000:1.0:1785390008.344910:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244672 00000100:00100000:1.0:1785390008.344914:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244672 00000100:00100000:1.0:1785390008.344959:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785390008.344969:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879244544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390008.345029:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879244544:12345-0@lo:400:kworker.0 Request processed in 61us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390008.345036:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785390008.345054:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785390008.345061:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879244672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.345178:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879244416:0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.345451:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390008.345477:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879244928:0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.345501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390008.345515:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390008.345521:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879244800:0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.345587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390008.345849:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244416 00000100:00100000:3.0:1785390008.345854:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244416 00000100:00100000:3.0:1785390008.345890:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1785390008.345897:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879244416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.345952:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879244416:12345-0@lo:400:kworker.0 Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390008.345959:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1785390008.345998:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245056 00000100:00100000:3.0:1785390008.346002:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245056 00000100:00100000:3.0:1785390008.346031:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244800 00000100:00100000:3.0:1785390008.346035:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244800 00000100:00100000:3.0:1785390008.346058:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785390008.346072:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879245056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.346105:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879245056:12345-0@lo:400:kworker.0 Request processed in 33us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390008.346110:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785390008.346121:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785390008.346127:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879244800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.346152:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879244800:12345-0@lo:400:kworker.0 Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390008.346171:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1785390008.346215:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12680 x1872116879244800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390008.346230:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879244800:0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.346240:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879244416:0@lo:400:kworker.0 00000100:00080000:3.0:1785390008.346313:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785390008.346325:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390008.346328:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390008.346341:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879244928 00000100:00100000:3.0:1785390008.346345:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879244928 00000100:00100000:3.0:1785390008.346370:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1785390008.346377:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879244928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.346414:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879244928:12345-0@lo:400:kworker.0 Request processed in 37us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390008.346420:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1785390008.346438:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390008.346455:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879244928:0@lo:400:kworker.0 00000100:00100000:3.0:1785390008.346497:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879244544:0@lo:400:kworker.0 00010000:00080000:3.0:1785390008.346509:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10e300 x1872116879245056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390008.346518:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879245056:0@lo:400:kworker.0 00000100:00100000:1.0:1785390008.348050:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879244672:12345-0@lo:400:kworker.0 Request processed in 2984us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390008.348947:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879244672:0@lo:400:kworker.0 00000100:00100000:1.0:1785390008.349993:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1785390008.793312:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390008.853782:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390008.853811:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879245184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390008.853935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390008.854024:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245184 00000100:00100000:1.0:1785390008.854041:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245184 00000100:00100000:1.0:1785390008.854100:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1785390008.854110:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879245184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390008.854156:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390008.854217:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879245184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390008.854224:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1785390008.854286:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50de81c00 x1872116879245184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390008.854306:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879245184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390009.367661:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785390009.367691:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879245312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390009.367776:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390009.367857:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245312 00000100:00100000:1.0:1785390009.367867:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245312 00000100:00100000:1.0:1785390009.367932:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785390009.367943:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879245312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390009.367986:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390009.368034:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879245312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390009.368042:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1785390009.368089:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e016d80 x1872116879245312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390009.368110:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879245312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785390009.815477:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390010.802043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390010.802293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390010.802372:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748864 00000100:00100000:3.0:1785390010.802386:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748864 00000100:00100000:3.0:1785390010.802470:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:3.0:1785390010.802483:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847748864:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:0.0:1785390010.802740:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390010.803724:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847748864:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1239us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390010.803735:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1785390010.806545:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748736 00000100:00100000:2.0:1785390010.806557:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748736 00000100:00100000:2.0:1785390010.806629:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1785390010.806638:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847748736:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390010.806719:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847748736:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 82us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390010.806726:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00010000:00010000:1.0:1785390010.840791:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390011.866284:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390012.887574:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390013.462133:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879245824:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462197:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390013.462248:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785390013.462253:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879245440:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390013.462297:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879245952:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390013.462345:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879245568:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390013.462382:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879246080:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390013.462415:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390013.462420:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879245696:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390013.462465:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245824 00000100:00100000:1.0:1785390013.462471:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245824 00000100:00100000:1.0:1785390013.462515:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246080 00000100:00100000:1.0:1785390013.462518:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246080 00000100:00100000:1.0:1785390013.462553:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785390013.462561:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879245824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462605:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879245824:12345-0@lo:400:kworker.0 Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390013.462612:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785390013.462626:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785390013.462631:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879246080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462670:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879246080:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390013.462675:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785390013.462690:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245440 00000100:00100000:1.0:1785390013.462692:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245440 00000100:00100000:1.0:1785390013.462709:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785390013.462715:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879245440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462738:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879245440:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390013.462744:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785390013.462765:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245952 00000100:00100000:1.0:1785390013.462768:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245952 00000100:00100000:1.0:1785390013.462804:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245568 00000100:00100000:1.0:1785390013.462807:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245568 00000100:00100000:1.0:1785390013.462816:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879245696 00000100:00100000:1.0:1785390013.462819:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879245696 00000100:00100000:1.0:1785390013.462832:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1785390013.462837:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879245952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462863:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879245952:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390013.462869:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1785390013.462890:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785390013.462896:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879245568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.462918:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879245568:12345-0@lo:400:kworker.0 Request processed in 23us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390013.463053:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1785390013.463065:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1785390013.463076:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879245696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.463103:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879245696:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390013.463108:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1785390013.463127:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785390013.463131:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785390013.463133:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390013.463165:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879245696:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.463175:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879245568:0@lo:400:kworker.0 00010000:00080000:1.0:1785390013.463185:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e014000 x1872116879246080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390013.463194:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879246080:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.463218:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879245440:0@lo:400:kworker.0 00000100:00100000:1.0:1785390013.463225:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879245952:0@lo:400:kworker.0 00010000:00080000:1.0:1785390013.463233:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e017100 x1872116879245824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390013.463241:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879245824:0@lo:400:kworker.0 00010000:00010000:2.0:1785390013.923292:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390013.989325:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390013.989348:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879246208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390013.990452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390013.990513:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246208 00000100:00100000:2.0:1785390013.990521:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246208 00000100:00100000:2.0:1785390013.990580:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785390013.990588:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879246208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390013.990623:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390013.991759:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879246208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1168us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390013.991766:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1785390013.992029:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e156680 x1872116879246208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390013.992051:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879246208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390014.495724:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390014.495763:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879246336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390014.495826:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390014.495905:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246336 00000100:00100000:2.0:1785390014.495912:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246336 00000100:00100000:2.0:1785390014.495955:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785390014.495963:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879246336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390014.496055:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390014.496148:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879246336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390014.496155:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1785390014.496215:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e157b80 x1872116879246336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390014.496232:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879246336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390014.938796:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390015.918499:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390015.918556:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390015.918584:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749120 00000100:00100000:2.0:1785390015.918593:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749120 00000100:00100000:2.0:1785390015.918648:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1785390015.918659:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847749120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390015.918728:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847749120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390015.918736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1785390015.918768:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847748992 00000100:00100000:2.0:1785390015.918772:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847748992 00000100:00100000:2.0:1785390015.918795:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:2.0:1785390015.918802:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847748992:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390015.918825:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847748992:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390015.918839:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00080000:2.0:1785390015.918880:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785390015.968069:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390016.981895:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390018.009985:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390018.583354:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879246592:0@lo:400:kworker.0 00000100:00100000:1.0:1785390018.583420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390018.583481:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879247104:0@lo:400:kworker.0 00000100:00100000:1.0:1785390018.583514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390018.583572:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390018.583578:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879246720:0@lo:400:kworker.0 00000100:00100000:1.0:1785390018.583598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390018.583624:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247104 00000100:00100000:1.0:1785390018.583631:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247104 00000100:00100000:1.0:1785390018.583675:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1785390018.583682:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53596d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879247104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390018.583726:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53596d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879247104:12345-0@lo:400:kworker.0 Request processed in 44us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390018.583733:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1785390018.583928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e155f80 x1872116879247104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390018.583942:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879247104:0@lo:400:kworker.0 00000100:00100000:2.0:1785390018.584075:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246592 00000100:00100000:2.0:1785390018.584079:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246592 00000100:00100000:2.0:1785390018.584112:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246720 00000100:00100000:2.0:1785390018.584115:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246720 00000100:00100000:2.0:1785390018.584135:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1785390018.584142:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879246592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390018.584182:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879246592:12345-0@lo:400:kworker.0 Request processed in 41us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390018.584188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1785390018.584211:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1785390018.584217:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879246720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390018.584240:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879246720:12345-0@lo:400:kworker.0 Request processed in 23us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390018.584245:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1785390018.584264:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785390018.584268:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390018.584287:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879246720:0@lo:400:kworker.0 00000100:00100000:2.0:1785390018.584296:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879246592:0@lo:400:kworker.0 00000100:00100000:0.0:1785390018.584485:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879246464:0@lo:400:kworker.0 00000100:00100000:0.0:1785390018.584519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390018.584568:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879246976:0@lo:400:kworker.0 00000100:00100000:0.0:1785390018.584588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390018.584610:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785390018.584615:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879246848:0@lo:400:kworker.0 00000100:00100000:0.0:1785390018.584635:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390018.584657:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246848 00000100:00100000:0.0:1785390018.584668:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246848 00000100:00100000:0.0:1785390018.584697:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1785390018.584703:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879246848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390018.584734:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879246848:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390018.584740:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1785390018.584756:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785390018.584770:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e155c00 x1872116879246848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390018.584781:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879246848:0@lo:400:kworker.0 00000100:00100000:2.0:1785390018.584850:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246464 00000100:00100000:2.0:1785390018.584854:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246464 00000100:00100000:2.0:1785390018.584884:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1785390018.584891:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879246464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390018.584921:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879246464:12345-0@lo:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390018.584933:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1785390018.585049:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879246464:0@lo:400:kworker.0 00000100:00100000:1.0:1785390018.585104:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879246976 00000100:00100000:1.0:1785390018.585108:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879246976 00000100:00100000:1.0:1785390018.585147:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785390018.585153:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879246976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390018.585186:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879246976:12345-0@lo:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390018.585191:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1785390018.585267:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390018.585285:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879246976:0@lo:400:kworker.0 00010000:00010000:1.0:1785390019.029690:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390019.106056:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390019.106087:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879247232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390019.106179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390019.106270:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247232 00000100:00100000:2.0:1785390019.106281:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247232 00000100:00100000:2.0:1785390019.106343:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1785390019.106354:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879247232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390019.106402:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390019.106454:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879247232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390019.106461:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1785390019.106546:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e157800 x1872116879247232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390019.106568:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879247232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390019.611341:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879247360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390019.611437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390019.611553:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247360 00000100:00100000:1.0:1785390019.611562:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247360 00000100:00100000:1.0:1785390019.611632:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785390019.611642:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879247360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390019.611692:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390019.611742:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879247360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390019.611750:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1785390019.611797:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e016680 x1872116879247360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390019.611816:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879247360:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1785390019.782212:0:9985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:40:17 (1785390017) === 00010000:00010000:3.0:1785390020.063462:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390020.472312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390020.474981:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749248 00000100:00100000:2.0:1785390020.475000:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749248 00000100:00100000:2.0:1785390020.475093:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:2.0:1785390020.475105:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+10:8111:x1872116847749248:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785390020.475129:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390020.475155:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecd05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1be98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390020.475192:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be98 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390020.475229:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be98 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390020.475240:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf501529e00, rc 0) 00000100:00100000:2.0:1785390020.475322:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8111:x1872116847749248:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 220us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390020.475330:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:2.0:1785390020.500789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390020.500871:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749376 00000100:00100000:0.0:1785390020.500884:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749376 00000100:00100000:0.0:1785390020.500951:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:0.0:1785390020.500962:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8111:x1872116847749376:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785390020.501322:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8111:x1872116847749376:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 361us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390020.501331:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:2.0:1785390020.521278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390020.521594:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749504 00000100:00100000:0.0:1785390020.521607:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749504 00000100:00100000:0.0:1785390020.521679:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:0.0:1785390020.521692:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8111:x1872116847749504:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1785390020.522037:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8111:x1872116847749504:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 346us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390020.522047:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:1.0:1785390020.524079:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390020.524491:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749632 00000100:00100000:2.0:1785390020.524503:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749632 00000100:00100000:2.0:1785390020.524601:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:2.0:1785390020.524612:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8115:x1872116847749632:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390020.524952:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8115:x1872116847749632:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 341us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390020.524960:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:2.0:1785390020.546574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390020.546689:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749760 00000100:00100000:0.0:1785390020.546702:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749760 00000100:00100000:0.0:1785390020.546766:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:0.0:1785390020.546776:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8115:x1872116847749760:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785390020.547114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8115:x1872116847749760:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 339us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390020.547122:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:3.0:1785390020.568147:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390020.576378:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847749888 00000100:00100000:0.0:1785390020.576399:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847749888 00000100:00100000:1.0:1785390020.581974:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:1.0:1785390020.581994:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+11:8111:x1872116847749888:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785390020.583671:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390020.583701:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f5c00/0x33dffe75ff5ecd0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bec2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390020.583740:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f5c00/0x33dffe75ff5ecd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec2 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390020.583752:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f5c00/0x33dffe75ff5ecd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec2 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390020.583762:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5c00, rc 0) 00000100:00100000:1.0:1785390020.583856:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:8111:x1872116847749888:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 1866us (15720us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390020.583864:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:0.0:1785390020.597327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390020.611467:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750016 00000100:00100000:2.0:1785390020.611485:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750016 00000100:00100000:1.0:1785390020.611631:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:1.0:1785390020.611659:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:8111:x1872116847750016:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1785390020.611692:0:5795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1785390020.611710:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1785390020.611713:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1785390020.611716:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1785390020.611718:0:5795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1785390020.615134:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:8111:x1872116847750016:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 3466us (17809us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390020.615149:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:0.0:1785390020.618172:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390020.618249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750144 00000100:00100000:3.0:1785390020.618260:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750144 00000100:00100000:3.0:1785390020.618322:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:3.0:1785390020.618332:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:8111:x1872116847750144:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1785390020.618353:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390020.618373:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bec9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390020.618409:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390020.618423:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390020.618434:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:3.0:1785390020.618495:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8111:x1872116847750144:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 165us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390020.618502:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:0.0:1785390020.619938:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390020.620083:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750272 00000100:00100000:1.0:1785390020.620092:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750272 00000100:00100000:1.0:1785390020.620137:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:1.0:1785390020.620147:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8111:x1872116847750272:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1785390020.620666:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8111:x1872116847750272:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 519us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390020.620675:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:0.0:1785390020.627468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390020.627581:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750400 00000100:00100000:3.0:1785390020.627593:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750400 00000100:00100000:3.0:1785390020.627652:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:3.0:1785390020.627677:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8111:x1872116847750400:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785390020.628007:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8111:x1872116847750400:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 274us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390020.628064:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:3.0:1785390020.632826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390020.636572:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750528 00000100:00100000:1.0:1785390020.636590:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750528 00000100:00100000:1.0:1785390020.636666:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:1.0:1785390020.636678:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8119:x1872116847750528:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785390020.638291:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8119:x1872116847750528:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 1504us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390020.638302:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:0.0:1785390020.665762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390020.665907:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750656 00000100:00100000:1.0:1785390020.666115:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750656 00000100:00100000:3.0:1785390020.666271:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:3.0:1785390020.666284:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8119:x1872116847750656:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785390020.666647:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:8119:x1872116847750656:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 366us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390020.666657:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:2.0:1785390020.676720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390020.676786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390020.676933:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750784 00000100:00100000:0.0:1785390020.676947:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750784 00000100:00100000:2.0:1785390020.677219:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1785390020.677229:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1872116847750784:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1785390020.677267:0:5803:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 25d495bf-c139-42e4-8792-c92077fd09ad@192.168.202.54@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:2.0:1785390020.677316:0:5803:0:(genops.c:1406:class_connect()) connect: client 25d495bf-c139-42e4-8792-c92077fd09ad, cookie 0x33dffe75ff5ecd1a 00000004:00100000:2.0:1785390020.677372:0:5803:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1785390020.677844:0:5803:0:(import.c:65:import_set_state_nolock()) ffff8cf5356cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390020.678133:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751168 00000100:00100000:0.0:1785390020.678139:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751168 00000100:00100000:0.0:1785390020.678202:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:0.0:1785390020.678211:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847751168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390020.678257:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847751168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 49us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390020.678266:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:2.0:1785390020.678649:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+6:2356:x1872116847750784:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 1420us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390020.678658:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00080000:3.0:1785390020.678769:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390020.710364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390020.710500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390020.717385:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751040 00000100:00100000:0.0:1785390020.717403:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751040 00000100:00100000:0.0:1785390020.717564:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847750912 00000100:00100000:0.0:1785390020.717568:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847750912 00000100:00100000:0.0:1785390020.717601:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1785390020.717612:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+7:8111:x1872116847751040:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:0.0:1785390020.717669:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1785390020.721413:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1785390020.721444:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+7:0:x1872116847750912:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:1.0:1785390020.721492:0:7121:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1785390020.724041:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+7:8111:x1872116847751040:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 6420us (13677us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390020.724055:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1785390020.724217:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:0:x1872116847750912:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 2782us (13709us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390020.724244:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00080000:3.0:1785390020.726419:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390020.731313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390020.731481:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751296 00000100:00100000:2.0:1785390020.731495:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751296 00000100:00100000:2.0:1785390020.731599:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1785390020.731612:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+6:8111:x1872116847751296:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1785390020.731730:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+6:8111:x1872116847751296:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 121us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390020.731738:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1785390020.739250:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390020.743191:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751680 00000100:00100000:3.0:1785390020.743205:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751680 00000100:00100000:3.0:1785390020.743269:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1785390020.743280:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:8111:x1872116847751680:12345-192.168.202.54@tcp:33:mount.lustre.0 00000100:00100000:0.0:1785390020.743490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000004:00200000:3.0:1785390020.743574:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1785390020.743890:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:8111:x1872116847751680:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 610us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390020.743899:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1785390020.750708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390020.759109:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751424 00000100:00100000:1.0:1785390020.759130:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751424 00000100:00100000:2.0:1785390020.765179:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751552 00000100:00100000:2.0:1785390020.765200:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751552 00000100:00100000:2.0:1785390020.765282:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:2.0:1785390020.765292:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1872116847751424:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785390020.765335:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 25d495bf-c139-42e4-8792-c92077fd09ad@192.168.202.54@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:2.0:1785390020.765377:0:6597:0:(genops.c:1406:class_connect()) connect: client 25d495bf-c139-42e4-8792-c92077fd09ad, cookie 0x33dffe75ff5ecd21 00002000:00100000:2.0:1785390020.765392:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 25d495bf-c139-42e4-8792-c92077fd09ad/ffff8cf5356cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785390020.765406:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1785390020.765484:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:0.0:1785390020.765492:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1872116847751552:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1785390020.765511:0:7936:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 25d495bf-c139-42e4-8792-c92077fd09ad@192.168.202.54@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:0.0:1785390020.765565:0:7936:0:(genops.c:1406:class_connect()) connect: client 25d495bf-c139-42e4-8792-c92077fd09ad, cookie 0x33dffe75ff5ecd28 00002000:00100000:0.0:1785390020.765572:0:7936:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 25d495bf-c139-42e4-8792-c92077fd09ad/ffff8cf535fe2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785390020.765594:0:7936:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785390020.765820:0:7936:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785390020.765859:0:7936:0:(import.c:65:import_set_state_nolock()) ffff8cf535fe3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390020.766066:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:2356:x1872116847751552:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 571us (15369us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390020.766074:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00002000:00080000:2.0:1785390020.768824:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785390020.768861:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf5356c9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785390020.768936:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:2356:x1872116847751424:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 3643us (25450us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390020.768946:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00010000:00010000:1.0:1785390021.078173:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390022.110429:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785390022.401676:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25d495bf-c139-42e4-8792-c92077fd09ad 00010000:00010000:0.0:1785390023.128010:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390023.706354:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879247616:0@lo:400:kworker.0 00000100:00100000:3.0:1785390023.706482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390023.706562:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879248128:0@lo:400:kworker.0 00000100:00100000:3.0:1785390023.706590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390023.706622:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390023.706628:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879247744:0@lo:400:kworker.0 00000100:00100000:3.0:1785390023.706650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390023.706673:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879247488:0@lo:400:kworker.0 00000100:00100000:3.0:1785390023.706681:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248128 00000100:00100000:3.0:1785390023.706687:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248128 00000100:00100000:1.0:1785390023.706705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390023.706724:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879248000:0@lo:400:kworker.0 00000100:00100000:3.0:1785390023.706739:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785390023.706744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390023.706746:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879248128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390023.706759:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785390023.706763:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879247872:0@lo:400:kworker.0 00000100:00100000:1.0:1785390023.706794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390023.706805:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879248128:12345-0@lo:400:kworker.0 Request processed in 59us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390023.706812:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785390023.706827:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247872 00000100:00100000:3.0:1785390023.706830:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247872 00000100:00100000:3.0:1785390023.706851:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785390023.706854:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247488 00000100:00100000:3.0:1785390023.706857:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879247872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390023.706857:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247488 00000100:00100000:1.0:1785390023.706883:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1785390023.706887:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879247872:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390023.706888:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879247488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390023.706892:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785390023.706916:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879247488:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390023.706922:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1785390023.706948:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247616 00000100:00100000:1.0:1785390023.706952:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247616 00000100:00100000:1.0:1785390023.706972:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879247744 00000100:00100000:1.0:1785390023.706975:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879247744 00000100:00100000:1.0:1785390023.706988:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248000 00000100:00100000:1.0:1785390023.706990:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248000 00000100:00100000:1.0:1785390023.707004:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785390023.707009:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879247616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390023.707038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879247616:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390023.707051:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1785390023.707064:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1785390023.707070:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879247744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390023.707669:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1785390023.707679:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879248000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390023.708705:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879247744:12345-0@lo:400:kworker.0 Request processed in 1633us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390023.708714:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1785390023.710273:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879248000:12345-0@lo:400:kworker.0 Request processed in 2592us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390023.710283:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1785390023.714463:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785390023.714474:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390023.714477:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390023.714773:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879247744:0@lo:400:kworker.0 00000100:00100000:2.0:1785390023.714799:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879247616:0@lo:400:kworker.0 00010000:00080000:2.0:1785390023.714814:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5182f9c00 x1872116879248128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390023.714825:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879248128:0@lo:400:kworker.0 00010000:00080000:2.0:1785390023.720726:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5182fb800 x1872116879247872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390023.720746:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879247872:0@lo:400:kworker.0 00000100:00100000:2.0:1785390023.720757:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879247488:0@lo:400:kworker.0 00000100:00100000:2.0:1785390023.720768:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879248000:0@lo:400:kworker.0 00010000:00010000:3.0:1785390024.150713:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390024.235791:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390024.235813:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390024.235876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390024.237001:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248256 00000100:00100000:1.0:1785390024.237011:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248256 00000100:00100000:1.0:1785390024.237056:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1785390024.237064:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879248256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390024.237099:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390024.237152:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879248256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390024.237159:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1785390024.238085:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e014000 x1872116879248256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390024.238107:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879248256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390024.727950:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390024.727981:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879248384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390024.728048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390024.729232:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248384 00000100:00100000:1.0:1785390024.729240:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248384 00000100:00100000:1.0:1785390024.729292:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785390024.729301:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879248384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390024.729335:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1785390024.729382:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879248384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390024.729389:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1785390024.729423:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e156d80 x1872116879248384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390024.729440:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879248384:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1785390024.844766:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25d495bf-c139-42e4-8792-c92077fd09ad 00010000:00010000:0.0:1785390025.177174:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785390025.865894:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25d495bf-c139-42e4-8792-c92077fd09ad 00000100:00100000:0.0:1785390026.169033:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390026.169075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390026.169111:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390026.169132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390026.169156:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390026.169183:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752320 00000100:00100000:0.0:1785390026.169192:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752320 00000100:00100000:0.0:1785390026.169256:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752192 00000100:00100000:0.0:1785390026.169259:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752192 00000100:00100000:0.0:1785390026.169296:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1785390026.169306:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752320:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390026.169377:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752320:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390026.169385:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1785390026.169413:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:0.0:1785390026.169420:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752192:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390026.169446:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752192:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390026.169452:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:0.0:1785390026.169471:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752064 00000100:00100000:0.0:1785390026.169474:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752064 00000100:00100000:0.0:1785390026.169500:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751936 00000100:00100000:0.0:1785390026.169503:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751936 00000100:00100000:0.0:1785390026.169521:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:0.0:1785390026.169554:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752064:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390026.169581:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752064:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390026.169588:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:0.0:1785390026.169601:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:0.0:1785390026.169608:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847751936:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390026.169631:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847751936:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390026.169637:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00080000:0.0:1785390026.169655:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390026.169659:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390026.169661:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390026.170486:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847751808 00000100:00100000:2.0:1785390026.170492:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847751808 00000100:00100000:2.0:1785390026.170551:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:2.0:1785390026.170559:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847751808:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390026.170599:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847751808:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390026.170616:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00010000:00010000:0.0:1785390026.197940:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390027.221768:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390028.246019:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390028.826088:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879248640:0@lo:400:kworker.0 00000100:00100000:1.0:1785390028.826157:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390028.827158:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879248896:0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.827216:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390028.827262:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248896 00000100:00100000:0.0:1785390028.827269:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248896 00000100:00100000:0.0:1785390028.827328:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785390028.827337:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879248896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.827385:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879248896:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390028.827391:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1785390028.827410:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390028.827437:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248640 00000100:00100000:0.0:1785390028.827440:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248640 00000100:00100000:0.0:1785390028.827462:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785390028.827467:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.827494:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879248640:12345-0@lo:400:kworker.0 Request processed in 27us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390028.827499:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785390028.827515:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879248768:0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.827558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390028.827582:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248768 00000100:00100000:0.0:1785390028.827585:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248768 00000100:00100000:0.0:1785390028.827609:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785390028.827614:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879248768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.827643:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879248768:12345-0@lo:400:kworker.0 Request processed in 28us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390028.827648:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1785390028.827664:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390028.829234:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879248512:0@lo:400:kworker.0 00000100:00100000:2.0:1785390028.829324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390028.829386:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879248512 00000100:00100000:2.0:1785390028.829394:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879248512 00000100:00100000:2.0:1785390028.829457:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1785390028.829467:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879248640:0@lo:400:kworker.0 00000100:00100000:2.0:1785390028.829471:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879248512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390028.829483:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879249152:0@lo:400:kworker.0 00000100:00100000:1.0:1785390028.829564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390028.829581:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879248512:12345-0@lo:400:kworker.0 Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390028.829591:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1785390028.829611:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249152 00000100:00100000:1.0:1785390028.829618:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249152 00000100:00100000:1.0:1785390028.829672:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785390028.829680:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879249152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390028.829751:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879249152:12345-0@lo:400:kworker.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390028.829758:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1785390028.829781:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1785390028.829811:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e015880 x1872116879248896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390028.829823:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879248896:0@lo:400:kworker.0 00000100:00100000:1.0:1785390028.829864:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879248768:0@lo:400:kworker.0 00000100:00100000:2.0:1785390028.830105:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879248512:0@lo:400:kworker.0 00000100:00100000:2.0:1785390028.830118:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879249024:0@lo:400:kworker.0 00000100:00100000:2.0:1785390028.830156:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1785390028.830241:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e016a00 x1872116879249152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390028.830253:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879249152:0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.830321:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249024 00000100:00100000:0.0:1785390028.830342:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249024 00000100:00100000:0.0:1785390028.830407:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1785390028.830415:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879249024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390028.830473:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879249024:12345-0@lo:400:kworker.0 Request processed in 59us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390028.830480:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1785390028.830554:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390028.831058:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879249024:0@lo:400:kworker.0 00010000:00010000:1.0:1785390029.282604:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390029.333805:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390029.333841:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879249280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390029.333966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390029.334194:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249280 00000100:00100000:0.0:1785390029.334205:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249280 00000100:00100000:0.0:1785390029.334270:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1785390029.334281:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879249280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785390029.334331:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390029.334395:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879249280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390029.334402:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1785390029.334574:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e156d80 x1872116879249280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390029.334617:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879249280:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1785390029.436382:0:10185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1785390029.846336:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390029.846360:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879249408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390029.846427:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390029.846490:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249408 00000100:00100000:3.0:1785390029.846496:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249408 00000100:00100000:3.0:1785390029.846558:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785390029.846567:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879249408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390029.846596:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1785390029.846633:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879249408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390029.846638:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1785390029.846675:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e156a00 x1872116879249408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390029.846698:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879249408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785390030.293916:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390031.278018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390031.278071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390031.278120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390031.278151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390031.278196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390031.278233:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752448 00000100:00100000:0.0:1785390031.278247:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752448 00000100:00100000:0.0:1785390031.278312:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:0.0:1785390031.278324:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847752448:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390031.278413:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847752448:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390031.278422:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:0.0:1785390031.278481:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752576 00000100:00100000:0.0:1785390031.278485:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752576 00000100:00100000:0.0:1785390031.278578:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752704 00000100:00100000:0.0:1785390031.278582:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752704 00000100:00100000:0.0:1785390031.278605:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:0.0:1785390031.278611:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847752576:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390031.278650:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847752576:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 38us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390031.278657:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:0.0:1785390031.278669:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:0.0:1785390031.278676:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752704:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390031.278722:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752704:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390031.278729:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:0.0:1785390031.278751:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752832 00000100:00100000:0.0:1785390031.278755:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752832 00000100:00100000:0.0:1785390031.278783:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847752960 00000100:00100000:0.0:1785390031.278786:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847752960 00000100:00100000:0.0:1785390031.278807:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1785390031.278813:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752832:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390031.278838:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752832:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390031.278845:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1785390031.278857:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:0.0:1785390031.278864:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752960:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390031.278886:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847752960:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390031.278900:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00080000:0.0:1785390031.279057:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390031.279062:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390031.279065:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785390031.319124:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390032.348161:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390033.367929:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390033.942176:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879249536:0@lo:400:kworker.0 00000100:00100000:3.0:1785390033.942277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390033.942384:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879250048:0@lo:400:kworker.0 00000100:00100000:3.0:1785390033.942434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390033.942465:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390033.942471:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879249920:0@lo:400:kworker.0 00000100:00100000:3.0:1785390033.942501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390033.942561:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249536 00000100:00100000:3.0:1785390033.942570:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249536 00000100:00100000:3.0:1785390033.942638:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1785390033.942648:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879249536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390033.942719:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879249536:12345-0@lo:400:kworker.0 Request processed in 72us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390033.942727:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1785390033.942786:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879249536:0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.943560:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879249664:0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.943600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390033.943632:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879250176:0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.943667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390033.943687:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390033.943708:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879249792:0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.943731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390033.943774:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250048 00000100:00100000:0.0:1785390033.943779:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250048 00000100:00100000:0.0:1785390033.943821:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249664 00000100:00100000:0.0:1785390033.943825:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249664 00000100:00100000:0.0:1785390033.943837:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249792 00000100:00100000:0.0:1785390033.943839:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249792 00000100:00100000:0.0:1785390033.943865:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785390033.943872:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879250048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.943917:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879250048:12345-0@lo:400:kworker.0 Request processed in 45us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390033.943923:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785390033.943940:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785390033.943957:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879249664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.943987:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879249664:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390033.944133:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1785390033.944146:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785390033.944152:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879249792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.944181:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879249792:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390033.944186:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785390033.944205:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879249920 00000100:00100000:0.0:1785390033.944209:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879249920 00000100:00100000:0.0:1785390033.944234:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250176 00000100:00100000:0.0:1785390033.944236:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250176 00000100:00100000:0.0:1785390033.944256:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1785390033.944263:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879249920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.944294:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879249920:12345-0@lo:400:kworker.0 Request processed in 32us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390033.944300:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1785390033.944310:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1785390033.944316:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879250176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.944338:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879250176:12345-0@lo:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390033.944344:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1785390033.944362:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390033.944367:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390033.944369:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390033.944402:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879249792:0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.944548:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879249664:0@lo:400:kworker.0 00010000:00080000:0.0:1785390033.944564:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e154000 x1872116879250176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390033.944582:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879250176:0@lo:400:kworker.0 00010000:00080000:0.0:1785390033.944617:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e154a80 x1872116879249920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390033.944626:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879249920:0@lo:400:kworker.0 00000100:00100000:0.0:1785390033.944637:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879250048:0@lo:400:kworker.0 00010000:00010000:1.0:1785390034.396654:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390034.455052:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390034.455080:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879250304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390034.455166:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390034.455248:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250304 00000100:00100000:2.0:1785390034.455265:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250304 00000100:00100000:2.0:1785390034.455711:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785390034.455723:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879250304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390034.455770:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390034.455819:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879250304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390034.455826:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1785390034.455902:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e156680 x1872116879250304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390034.455922:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879250304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390034.970665:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390034.970705:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879250432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390034.970788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390034.970864:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250432 00000100:00100000:3.0:1785390034.970873:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250432 00000100:00100000:3.0:1785390034.970936:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785390034.970944:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879250432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390034.970987:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1785390034.971031:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879250432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390034.971038:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1785390034.971085:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5182fb800 x1872116879250432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390034.971103:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879250432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785390035.414925:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390036.400006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390036.400059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390036.400094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390036.400118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390036.400145:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390036.400178:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753600 00000100:00100000:1.0:1785390036.400199:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753600 00000100:00100000:1.0:1785390036.400267:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753472 00000100:00100000:1.0:1785390036.400270:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753472 00000100:00100000:1.0:1785390036.400296:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1785390036.400309:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753600:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390036.400402:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753600:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 96us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390036.400410:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1785390036.400429:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:1.0:1785390036.400435:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753472:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390036.400460:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753472:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390036.400466:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:1.0:1785390036.400486:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753344 00000100:00100000:1.0:1785390036.400489:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753344 00000100:00100000:1.0:1785390036.400513:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753216 00000100:00100000:1.0:1785390036.400516:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753216 00000100:00100000:1.0:1785390036.400572:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:1.0:1785390036.400579:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753344:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390036.400608:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753344:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390036.400615:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:1.0:1785390036.400626:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:1.0:1785390036.400632:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847753216:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390036.400652:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847753216:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 20us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390036.400663:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00080000:1.0:1785390036.400697:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785390036.400703:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785390036.400705:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390036.400986:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753088 00000100:00100000:2.0:1785390036.400991:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753088 00000100:00100000:2.0:1785390036.401038:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:2.0:1785390036.401045:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847753088:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390036.401086:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847753088:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 42us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390036.401092:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00010000:00010000:1.0:1785390036.437842:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390037.463900:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390038.490018:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390039.063834:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879250944:0@lo:400:kworker.0 00000100:00100000:0.0:1785390039.063852:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879250816:0@lo:400:kworker.0 00000100:00100000:3.0:1785390039.063934:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879250560:0@lo:400:kworker.0 00000100:00100000:2.0:1785390039.070969:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879250688:0@lo:400:kworker.0 00000100:00100000:2.0:1785390039.071063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390039.071128:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879251200:0@lo:400:kworker.0 00000100:00100000:2.0:1785390039.071153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390039.071292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390039.071419:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250688 00000100:00100000:1.0:1785390039.071430:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250688 00000100:00100000:1.0:1785390039.071494:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1785390039.071504:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879250688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390039.071599:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879250688:12345-0@lo:400:kworker.0 Request processed in 95us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390039.071607:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1785390039.072740:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251200 00000100:00100000:1.0:1785390039.072748:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251200 00000100:00100000:1.0:1785390039.072792:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250944 00000100:00100000:1.0:1785390039.072795:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250944 00000100:00100000:1.0:1785390039.072815:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785390039.072822:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879251200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390039.072871:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879251200:12345-0@lo:400:kworker.0 Request processed in 49us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390039.072879:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1785390039.072890:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785390039.072896:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879250944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390039.072931:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879250944:12345-0@lo:400:kworker.0 Request processed in 35us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390039.072937:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785390039.072999:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879250688:0@lo:400:kworker.0 00010000:00080000:1.0:1785390039.073015:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535924a80 x1872116879251200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390039.073026:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879251200:0@lo:400:kworker.0 00000100:00080000:1.0:1785390039.073054:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785390039.073058:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1785390039.075853:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535926300 x1872116879250944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390039.075875:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879250944:0@lo:400:kworker.0 00000100:00100000:0.0:1785390039.076268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390039.078826:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250816 00000100:00100000:2.0:1785390039.078843:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250816 00000100:00100000:2.0:1785390039.078923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785390039.078937:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879250816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390039.079049:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879250816:12345-0@lo:400:kworker.0 Request processed in 115us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390039.079057:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785390039.079432:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879250816:0@lo:400:kworker.0 00000100:00100000:3.0:1785390039.083589:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390039.083686:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879251072:0@lo:400:kworker.0 00000100:00080000:1.0:1785390039.083730:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390039.083740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390039.083888:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879250560 00000100:00100000:0.0:1785390039.083900:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879250560 00000100:00100000:0.0:1785390039.083963:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1785390039.083974:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390039.084042:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879250560:12345-0@lo:400:kworker.0 Request processed in 70us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390039.084051:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1785390039.084086:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251072 00000100:00100000:1.0:1785390039.084092:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251072 00000100:00100000:1.0:1785390039.084146:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1785390039.084152:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390039.084155:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879251072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390039.084195:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879251072:12345-0@lo:400:kworker.0 Request processed in 43us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390039.084202:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1785390039.084245:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879250560:0@lo:400:kworker.0 00000100:00100000:3.0:1785390039.084260:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879251072:0@lo:400:kworker.0 00010000:00010000:2.0:1785390039.510798:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390039.580063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390039.580100:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879251328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390039.580193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390039.580627:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251328 00000100:00100000:2.0:1785390039.580637:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251328 00000100:00100000:2.0:1785390039.580705:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1785390039.580715:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879251328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390039.580765:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390039.580825:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879251328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390039.580833:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1785390039.580972:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e155f80 x1872116879251328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390039.580998:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879251328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390040.087143:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879251456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390040.087232:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390040.087323:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251456 00000100:00100000:3.0:1785390040.087332:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251456 00000100:00100000:3.0:1785390040.088701:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1785390040.088715:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879251456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390040.088767:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1785390040.088904:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879251456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390040.088913:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1785390040.088975:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5182f8a80 x1872116879251456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390040.088998:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879251456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785390040.539925:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390041.530434:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390041.530491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390041.530539:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390041.530571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390041.530879:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753728 00000100:00100000:0.0:1785390041.530894:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753728 00000100:00100000:0.0:1785390041.531032:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:0.0:1785390041.531045:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847753728:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390041.531138:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847753728:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 96us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390041.531156:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:3.0:1785390041.531346:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753856 00000100:00100000:3.0:1785390041.531351:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753856 00000100:00080000:0.0:1785390041.531423:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390041.531593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390041.531704:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754112 00000100:00100000:0.0:1785390041.531709:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754112 00000100:00100000:0.0:1785390041.531745:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754240 00000100:00100000:0.0:1785390041.531748:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754240 00000100:00100000:0.0:1785390041.531772:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785390041.531779:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2356:x1872116847754112:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:0.0:1785390041.531806:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecd21 00000100:00080000:0.0:1785390041.531826:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf5356c9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785390041.531876:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1785390041.532262:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d495bf-c139-42e4-8792-c92077fd09ad+2:2356:x1872116847754112:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 482us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390041.532272:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785390041.532287:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390041.532294:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2356:x1872116847754240:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:0.0:1785390041.532307:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecd28 00000100:00080000:0.0:1785390041.532314:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf535fe3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1785390041.532338:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1785390041.532578:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d495bf-c139-42e4-8792-c92077fd09ad+2:2356:x1872116847754240:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 283us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390041.532586:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:0.0:1785390041.532608:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390041.532614:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785390041.532633:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390041.532637:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390041.534565:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847753984 00000100:00100000:0.0:1785390041.534580:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847753984 00000100:00100000:0.0:1785390041.534671:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:0.0:1785390041.534684:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753984:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390041.534755:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847753984:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 75us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390041.534763:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00080000:0.0:1785390041.534786:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390041.535956:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:3.0:1785390041.535969:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847753856:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390041.536015:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847753856:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 51us (5598us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390041.536023:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00010000:00010000:3.0:1785390041.558741:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390042.582705:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1785390042.725758:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25d495bf-c139-42e4-8792-c92077fd09ad 00000020:00000080:0.0:1785390042.725770:0:6622:0:(genops.c:906:class_export_put()) final put ffff8cf5356cf000/25d495bf-c139-42e4-8792-c92077fd09ad 00000020:00000080:2.0:1785390042.725881:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5356cf000/25d495bf-c139-42e4-8792-c92077fd09ad for lustre-OST0000 00000020:00000080:2.0:1785390042.725953:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf5356c9000 for lustre-OST0000 00010000:00010000:2.0:1785390043.613728:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390044.187816:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879251584:0@lo:400:kworker.0 00000100:00100000:3.0:1785390044.187927:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390044.188337:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879251712:0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.188379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390044.188437:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879252224:0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.188480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390044.188519:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390044.188554:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879251840:0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.188579:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390044.188629:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252224 00000100:00100000:1.0:1785390044.188638:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252224 00000100:00100000:1.0:1785390044.188706:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785390044.188716:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879252224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.188779:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879252224:12345-0@lo:400:kworker.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390044.188788:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1785390044.188844:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535fbd880 x1872116879252224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390044.188861:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879252224:0@lo:400:kworker.0 00000100:00080000:1.0:1785390044.188901:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390044.188915:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251712 00000100:00100000:1.0:1785390044.188919:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251712 00000100:00100000:1.0:1785390044.188957:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251840 00000100:00100000:1.0:1785390044.188960:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251840 00000100:00100000:1.0:1785390044.188985:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1785390044.188992:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879251712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.189032:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879251712:12345-0@lo:400:kworker.0 Request processed in 40us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390044.189039:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1785390044.189053:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1785390044.192324:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879252096:0@lo:400:kworker.0 00000100:00100000:3.0:1785390044.192402:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390044.192422:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390044.192429:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879251968:0@lo:400:kworker.0 00000100:00100000:3.0:1785390044.192459:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390044.192537:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252096 00000100:00100000:3.0:1785390044.192546:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252096 00000100:00100000:1.0:1785390044.192656:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879251840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.192734:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879251840:12345-0@lo:400:kworker.0 Request processed in 84us (4153us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390044.192931:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251584 00000100:00100000:0.0:1785390044.192936:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251584 00000100:00100000:0.0:1785390044.192980:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1785390044.192987:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879251584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390044.193036:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879251584:12345-0@lo:400:kworker.0 Request processed in 50us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390044.193043:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1785390044.193584:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879251968 00000100:00100000:0.0:1785390044.193590:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879251968 00000100:00100000:0.0:1785390044.193635:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785390044.193642:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879251968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390044.193678:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879251968:12345-0@lo:400:kworker.0 Request processed in 37us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390044.193684:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1785390044.193734:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390044.193739:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390044.193783:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879251840:0@lo:400:kworker.0 00000100:00100000:0.0:1785390044.193810:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879251712:0@lo:400:kworker.0 00010000:00080000:0.0:1785390044.193873:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535fbdf80 x1872116879251968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390044.193884:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879251968:0@lo:400:kworker.0 00000100:00100000:0.0:1785390044.193896:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879251584:0@lo:400:kworker.0 00000100:00100000:3.0:1785390044.193994:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785390044.194003:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879252096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390044.194043:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879252096:12345-0@lo:400:kworker.0 Request processed in 42us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390044.194050:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1785390044.194141:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879252096:0@lo:400:kworker.0 00000100:00100000:1.0:1785390044.195127:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:3.0:1785390044.629730:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390044.696699:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879252352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390044.698310:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390044.699298:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252352 00000100:00100000:3.0:1785390044.699312:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252352 00000100:00100000:3.0:1785390044.699384:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1785390044.699397:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879252352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390044.699451:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390044.699549:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879252352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390044.699558:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1785390044.700176:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53ff8f800 x1872116879252352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390044.700201:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879252352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390045.208329:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879252480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390045.209622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390045.210225:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252480 00000100:00100000:2.0:1785390045.210238:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252480 00000100:00100000:2.0:1785390045.210310:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1785390045.210323:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879252480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390045.210394:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390045.210455:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879252480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390045.210463:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1785390045.210515:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10d880 x1872116879252480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390045.210556:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879252480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785390045.656302:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785390046.369839:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25d495bf-c139-42e4-8792-c92077fd09ad 00000020:00000080:3.0:1785390046.369863:0:7506:0:(genops.c:906:class_export_put()) final put ffff8cf535fe2000/25d495bf-c139-42e4-8792-c92077fd09ad 00000020:00000080:3.0:1785390046.369900:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe2000/25d495bf-c139-42e4-8792-c92077fd09ad for lustre-OST0001 00000020:00000080:3.0:1785390046.369966:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf535fe3800 for lustre-OST0001 00000100:00100000:1.0:1785390046.639841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390046.639940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390046.640002:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390046.643978:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754368 00000100:00100000:1.0:1785390046.643995:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754368 00000100:00100000:1.0:1785390046.644082:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:1.0:1785390046.644106:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847754368:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390046.644210:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847754368:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 115us (4265us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390046.644217:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:0.0:1785390046.646006:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754496 00000100:00100000:0.0:1785390046.646015:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754496 00000100:00100000:1.0:1785390046.646154:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754624 00000100:00080000:0.0:1785390046.646228:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390046.646840:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754624 00000100:00100000:1.0:1785390046.646892:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:1.0:1785390046.646901:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847754496:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390046.647044:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847754496:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 142us (7892us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390046.647052:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:1.0:1785390046.647089:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:1.0:1785390046.647096:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847754624:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390046.647126:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847754624:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390046.647133:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00080000:0.0:1785390046.647302:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785390046.678255:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390047.701666:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390048.729952:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390049.313176:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879252992:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313243:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390049.313295:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785390049.313300:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879252608:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313325:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390049.313343:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879253120:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390049.313405:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879252864:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390049.313446:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1785390049.313464:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879252736:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390049.313500:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879253248:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390049.313593:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252992 00000100:00100000:3.0:1785390049.313599:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252992 00000100:00100000:3.0:1785390049.313646:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253248 00000100:00100000:3.0:1785390049.313649:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253248 00000100:00100000:3.0:1785390049.313672:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785390049.313681:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879252992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313733:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879252992:12345-0@lo:400:kworker.0 Request processed in 52us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390049.313740:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1785390049.313781:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785390049.313788:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879253248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313840:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879253248:12345-0@lo:400:kworker.0 Request processed in 52us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390049.313847:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1785390049.313865:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253120 00000100:00100000:3.0:1785390049.313869:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253120 00000100:00100000:3.0:1785390049.313892:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252864 00000100:00100000:3.0:1785390049.313895:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252864 00000100:00100000:3.0:1785390049.313908:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252736 00000100:00100000:3.0:1785390049.313910:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252736 00000100:00100000:3.0:1785390049.313922:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785390049.313928:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879253120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.313959:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879253120:12345-0@lo:400:kworker.0 Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390049.313965:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785390049.313978:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785390049.313984:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879252864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.314010:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879252864:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390049.314016:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1785390049.314027:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1785390049.314033:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879252736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.314059:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879252736:12345-0@lo:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390049.314064:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1785390049.314098:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879253120:0@lo:400:kworker.0 00010000:00080000:3.0:1785390049.314119:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10dc00 x1872116879252992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390049.314129:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879252992:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.314155:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879252736:0@lo:400:kworker.0 00010000:00080000:3.0:1785390049.314165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10d880 x1872116879253248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390049.314173:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879253248:0@lo:400:kworker.0 00000100:00100000:3.0:1785390049.314182:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879252864:0@lo:400:kworker.0 00000100:00100000:0.0:1785390049.314289:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879252608 00000100:00100000:0.0:1785390049.314294:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879252608 00000100:00100000:0.0:1785390049.314317:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1785390049.314323:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879252608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390049.314364:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879252608:12345-0@lo:400:kworker.0 Request processed in 41us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390049.314371:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1785390049.314408:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390049.314411:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390049.314413:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390049.314433:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879252608:0@lo:400:kworker.0 00010000:00010000:3.0:1785390049.761629:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390049.814361:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879253376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390049.814431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390049.822613:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253376 00000100:00100000:2.0:1785390049.822625:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253376 00000100:00100000:2.0:1785390049.822685:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785390049.822695:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879253376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390049.822734:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390049.822811:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879253376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (8379us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390049.822818:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1785390049.822946:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535fbc000 x1872116879253376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390049.822968:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879253376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390050.330965:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879253504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390050.331027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390050.331092:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253504 00000100:00100000:3.0:1785390050.331099:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253504 00000100:00100000:3.0:1785390050.331137:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1785390050.331144:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879253504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390050.331175:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390050.331228:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879253504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390050.331235:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1785390050.331271:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b12300 x1872116879253504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390050.331288:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879253504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785390050.773756:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390051.768815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390051.768858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390051.768885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390051.769000:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755008 00000100:00100000:3.0:1785390051.769010:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755008 00000100:00100000:3.0:1785390051.769064:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754880 00000100:00100000:3.0:1785390051.769067:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754880 00000100:00100000:3.0:1785390051.769086:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:3.0:1785390051.769095:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847755008:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390051.769162:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847755008:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390051.769170:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:3.0:1785390051.769185:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:3.0:1785390051.769191:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847754880:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390051.769216:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847754880:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390051.769223:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:0.0:1785390051.769298:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847754752 00000100:00100000:0.0:1785390051.769302:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847754752 00000100:00100000:0.0:1785390051.769340:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00100000:0.0:1785390051.769347:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847754752:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390051.769388:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847754752:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390051.769395:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 243 00000100:00080000:1.0:1785390051.769555:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785390051.797717:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390052.829703:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785390052.961456:0:10890:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1785390053.847020:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390054.421694:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879253760:0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.421767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390054.421821:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879254272:0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.421864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390054.421895:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390054.421900:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879253888:0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.421931:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390054.421961:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253760 00000100:00100000:3.0:1785390054.421968:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253760 00000100:00100000:3.0:1785390054.422010:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253888 00000100:00100000:3.0:1785390054.422013:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253888 00000100:00100000:3.0:1785390054.422036:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785390054.422043:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879253760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.422087:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879253760:12345-0@lo:400:kworker.0 Request processed in 44us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390054.422092:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785390054.422105:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1785390054.422110:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879253888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.422144:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879253888:12345-0@lo:400:kworker.0 Request processed in 34us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390054.422150:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1785390054.422208:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254272 00000100:00100000:3.0:1785390054.422226:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254272 00000100:00100000:3.0:1785390054.422514:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1785390054.422548:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879254272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.422582:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879254272:12345-0@lo:400:kworker.0 Request processed in 61us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390054.422588:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1785390054.422608:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390054.422611:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390054.422718:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879254016:0@lo:400:kworker.0 00000100:00100000:1.0:1785390054.422751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390054.422767:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785390054.422771:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879253632:0@lo:400:kworker.0 00000100:00100000:1.0:1785390054.422804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390054.422822:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879254144:0@lo:400:kworker.0 00000100:00100000:1.0:1785390054.422853:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390054.423011:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879253888:0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.423029:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879253760:0@lo:400:kworker.0 00010000:00080000:3.0:1785390054.423040:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10dc00 x1872116879254272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390054.423049:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879254272:0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.423079:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879253632 00000100:00100000:3.0:1785390054.423082:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879253632 00000100:00100000:3.0:1785390054.423104:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1785390054.423108:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879253632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390054.423224:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254016 00000100:00100000:0.0:1785390054.423229:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254016 00000100:00100000:0.0:1785390054.423257:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785390054.423295:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879254016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390054.425578:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254144 00000100:00100000:2.0:1785390054.425587:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254144 00000100:00100000:2.0:1785390054.425638:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1785390054.425645:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879254144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390054.430477:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879253632:12345-0@lo:400:kworker.0 Request processed in 7359us (7662us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390054.430490:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1785390054.430553:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785390054.430559:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390054.431241:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879253632:0@lo:400:kworker.0 00010000:00080000:1.0:1785390054.431257:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10d880 x1872116879254016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390054.431303:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879254016:0@lo:400:kworker.0 00000100:00100000:0.0:1785390054.432726:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879254016:12345-0@lo:400:kworker.0 Request processed in 9459us (9968us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390054.432737:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785390054.434781:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879254144:12345-0@lo:400:kworker.0 Request processed in 9132us (11922us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390054.434791:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785390054.439257:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879254144:0@lo:400:kworker.0 00010000:00010000:3.0:1785390054.869790:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390054.937858:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390054.941681:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879254400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390054.941751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390054.941859:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254400 00000100:00100000:2.0:1785390054.941876:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254400 00000100:00100000:2.0:1785390054.941925:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1785390054.941934:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879254400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390054.941969:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390054.942013:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879254400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390054.942019:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1785390054.942087:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e155180 x1872116879254400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390054.942106:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879254400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390055.461459:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390055.461490:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879254528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390055.461625:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390055.461702:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254528 00000100:00100000:2.0:1785390055.461711:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254528 00000100:00100000:2.0:1785390055.461766:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785390055.461776:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879254528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390055.461821:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390055.461873:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879254528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390055.461881:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1785390055.461926:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535926a00 x1872116879254528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390055.461947:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879254528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390055.894540:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390056.881805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390056.883415:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755264 00000100:00100000:3.0:1785390056.883426:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755264 00000100:00100000:3.0:1785390056.883495:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:3.0:1785390056.883507:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847755264:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390056.883590:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847755264:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 86us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390056.883597:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00080000:1.0:1785390056.883921:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390056.898387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390056.898453:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390056.899395:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755392 00000100:00100000:2.0:1785390056.899405:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755392 00000100:00100000:2.0:1785390056.899465:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1785390056.899475:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847755392:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390056.899571:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847755392:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 97us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390056.899590:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00080000:1.0:1785390056.899866:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390056.910520:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755136 00000100:00100000:3.0:1785390056.910565:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755136 00000100:00100000:3.0:1785390056.912299:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 245 00000100:00100000:3.0:1785390056.912311:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847755136:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390056.912556:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847755136:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 247us (14176us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390056.912565:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 245 00010000:00010000:3.0:1785390056.931277:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785390057.561350:0:11038:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc13dfca0 20000000:00000080:0.0:1785390057.561365:0:11038:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf5180e1000 uarg=0000000000000000 20000000:01000000:0.0:1785390057.561400:0:11038:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785390057.561405:0:11038:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785390057.561409:0:11038:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1785390057.564513:0:11039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1785390057.568378:0:11038:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1785390057.578439:0:11038:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1785390057.582208:0:11038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582230:0:11038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582288:0:11038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582295:0:11038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582301:0:11038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582307:0:11038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582313:0:11038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582365:0:11038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582377:0:11038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 12 pid: 5797 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.582391:0:11038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879254656:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390057.582579:0:11038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582587:0:11038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 18 pid: 5797 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.582609:0:11038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879254784:0@lo:104: 00000100:00100000:1.0:1785390057.582644:0:11038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785390057.582700:0:11038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582707:0:11038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 18 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.582729:0:11038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879254912:0@lo:104: 00000100:00100000:1.0:1785390057.582745:0:11038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785390057.582766:0:11038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582772:0:11038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 18 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.582788:0:11038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879255040:0@lo:104: 00000100:00100000:1.0:1785390057.582805:0:11038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1785390057.582819:0:11038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.582826:0:11038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 12 pid: 5798 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.582833:0:11038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879255168:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390057.582853:0:11038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e840 going to sleep for 11 seconds 00000100:00100000:3.0:1785390057.583765:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254784 00000100:00100000:3.0:1785390057.583779:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254784 00000100:00100000:3.0:1785390057.583815:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879254912 00000100:00100000:3.0:1785390057.583818:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879254912 00000100:00100000:3.0:1785390057.583827:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255040 00000100:00100000:3.0:1785390057.583828:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255040 00000100:00100000:3.0:1785390057.583840:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785390057.583848:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:11038:x1872116879254784:12345-0@lo:104: 00010000:00010000:3.0:1785390057.583859:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.583920:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785390057.583926:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:11038:x1872116879254784:12345-0@lo:104: Request processed in 79us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390057.583933:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785390057.583949:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785390057.583955:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:11038:x1872116879254912:12345-0@lo:104: 00010000:00010000:3.0:1785390057.583962:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.583992:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785390057.583997:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:11038:x1872116879254912:12345-0@lo:104: Request processed in 43us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390057.584003:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785390057.584013:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1785390057.584018:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:11038:x1872116879255040:12345-0@lo:104: 00010000:00010000:3.0:1785390057.584025:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584048:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1785390057.584058:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:11038:x1872116879255040:12345-0@lo:104: Request processed in 40us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390057.584064:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1785390057.584079:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785390057.584084:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584091:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf501528c00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390057.584095:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584103:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390057.584111:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390057.584116:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785390057.584154:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584160:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390057.584179:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584187:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf501528c00/0x33dffe75ff5eccf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eccfe expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584199:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785390057.584202:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584218:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390057.584221:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584228:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390057.584235:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390057.584252:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785390057.584265:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584270:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390057.584285:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584291:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4400/0x33dffe75ff5ecce9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eccf0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584301:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390057.584304:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584310:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf501528400 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390057.584313:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584330:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390057.584337:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390057.584343:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785390057.584364:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584371:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390057.584377:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584382:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf501528400/0x33dffe75ff5eccdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecce2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.584394:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390057.584396:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390057.584398:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390057.584404:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390057.584415:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879255296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390057.584445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390057.584493:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879255424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390057.584514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390057.584555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390057.584561:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879255552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390057.584580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390057.584614:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255296 00000100:00100000:3.0:1785390057.584617:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255296 00010000:00010000:3.0:1785390057.584634:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 19 pid: 5797 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390057.584648:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255424 00000100:00100000:3.0:1785390057.584650:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255424 00010000:00010000:3.0:1785390057.584658:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 20 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390057.584668:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255552 00000100:00100000:3.0:1785390057.584670:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255552 00010000:00010000:3.0:1785390057.585018:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 21 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390057.585034:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785390057.585040:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+21:3310:x1872116879255296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390057.585050:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390057.585056:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 21 pid: 5797 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.585065:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 21 pid: 5797 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.585079:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390057.585110:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+21:3310:x1872116879255296:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390057.585117:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1785390057.585785:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785390057.585792:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3307:x1872116879255424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390057.585809:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390057.585814:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 20 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.585824:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 20 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.585834:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390057.585866:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3307:x1872116879255424:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390057.585873:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785390057.585885:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785390057.585891:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879255552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390057.585898:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390057.585903:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 19 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.585910:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 19 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.585919:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390057.585938:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879255552:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390057.585943:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1785390057.585982:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879255296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785390057.586049:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879255552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785390057.586056:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879255424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390057.586424:0:11038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5eccfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eccf7 expref: 18 pid: 5797 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.586437:0:11038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879254784:0@lo:104: 00010000:00010000:1.0:1785390057.586446:0:11038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5eccf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecce9 expref: 17 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.586453:0:11038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879254912:0@lo:104: 00010000:00010000:1.0:1785390057.586461:0:11038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529a00/0x33dffe75ff5ecce2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eccdb expref: 16 pid: 5798 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390057.586470:0:11038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879255040:0@lo:104: 00000100:00100000:2.0:1785390057.595981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390057.596018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390057.598778:0:11038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879254656:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390057.598792:0:11038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11038:1872116879255168:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390057.598825:0:11038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390057.598956:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755648 00000100:00100000:0.0:1785390057.598963:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755648 00010000:00010000:0.0:1785390057.598995:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 13 pid: 5798 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390057.599024:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755520 00000100:00100000:0.0:1785390057.599027:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755520 00010000:00010000:0.0:1785390057.599036:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 14 pid: 5797 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390057.599048:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1785390057.599055:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfce36af-778b-4771-80c2-03c6feec7bb9+14:2359:x1872116847755648:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390057.599068:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390057.599073:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 14 pid: 5798 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.599081:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 14 pid: 5798 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.599096:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4e00/0x33dffe75ff5eccd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be91 expref: 14 pid: 5798 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.599111:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390057.599358:0:5788:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1785390057.599365:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1785390057.600191:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847755648:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1133us (4218us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390057.600199:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1785390057.600217:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1785390057.600224:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:2359:x1872116847755520:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390057.600249:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390057.600254:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 12 pid: 5797 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600264:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 12 pid: 5797 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600275:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5600/0x33dffe75ff5ecd13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec9 expref: 12 pid: 5797 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600287:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600296:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600308:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600315:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600323:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600330:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600336:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390057.600339:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600356:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600374:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390057.600382:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390057.600400:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfce36af-778b-4771-80c2-03c6feec7bb9+11:2359:x1872116847755520:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 177us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390057.600406:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00010000:00010000:1.0:1785390057.600551:0:11038:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.600560:0:11038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390057.600567:0:11038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f5a00/0x33dffe75ff5ecd2f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390057.942824:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390058.797458:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390058.797567:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755776 00000100:00100000:0.0:1785390058.797582:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755776 00000100:00100000:0.0:1785390058.797647:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:0.0:1785390058.797656:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+11:5582:x1872116847755776:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390058.797674:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390058.797694:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bef3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390058.797722:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390058.797733:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390058.797743:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717400, rc 0) 00000100:00100000:0.0:1785390058.797809:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847755776:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 153us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390058.797831:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 246 00000100:00100000:1.0:1785390058.807275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390058.807370:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847755904 00000100:00100000:3.0:1785390058.807391:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847755904 00000100:00100000:3.0:1785390058.807438:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:3.0:1785390058.807446:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847755904:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390058.807800:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847755904:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 353us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390058.807809:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 247 00000100:00100000:2.0:1785390058.832687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390058.833675:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756032 00000100:00100000:1.0:1785390058.833685:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756032 00000100:00100000:1.0:1785390058.833744:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 248 00000100:00100000:1.0:1785390058.833753:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847756032:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390058.833972:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847756032:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 218us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390058.833979:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 248 00000100:00100000:1.0:1785390058.839637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390058.839723:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756160 00000100:00100000:0.0:1785390058.839732:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756160 00000100:00100000:0.0:1785390058.839780:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:0.0:1785390058.839789:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847756160:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390058.839806:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390058.839821:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1befa expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390058.839847:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390058.839866:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390058.839876:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717000, rc 0) 00000100:00100000:0.0:1785390058.840002:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847756160:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 213us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390058.840010:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 249 00000100:00100000:2.0:1785390058.852066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390058.852434:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756288 00000100:00100000:0.0:1785390058.852444:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756288 00000100:00100000:0.0:1785390058.852506:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:0.0:1785390058.852517:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847756288:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390058.852808:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847756288:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 292us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390058.852816:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 250 00000100:00100000:0.0:1785390058.859443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390058.859560:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756416 00000100:00100000:1.0:1785390058.859569:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756416 00000100:00100000:1.0:1785390058.859618:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 251 00000100:00100000:1.0:1785390058.859627:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847756416:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390058.859810:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847756416:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390058.859826:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 251 00010000:00010000:3.0:1785390058.965874:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1785390059.419371:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785390059.419378:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf53b946000 from 7 10000000:01000000:0.0:1785390059.419383:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785390059.419422:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390059.419434:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390059.419445:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390059.419478:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879255680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785390059.419562:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390059.419603:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1785390059.419666:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255680 00000100:00100000:1.0:1785390059.419673:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255680 00000100:00100000:1.0:1785390059.419711:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1785390059.419719:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879255680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390059.419732:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390059.419744:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecd44 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390059.419764:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390059.419774:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390059.419783:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4a00, rc 0) 00000100:00100000:1.0:1785390059.419824:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879255680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390059.419831:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1785390059.419991:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879255680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390059.420004:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.420013:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390059.420072:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879255808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.420096:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390059.420217:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255808 00000100:00100000:0.0:1785390059.420221:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255808 00000100:00100000:0.0:1785390059.420250:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1785390059.420257:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879255808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.420476:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390059.431060:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879255808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10794us (10953us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390059.431074:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1785390059.431242:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879255808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390059.431301:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879255936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390059.431351:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390059.431404:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390059.431814:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879255936 00000100:00100000:0.0:1785390059.431820:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879255936 00000100:00100000:0.0:1785390059.431866:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1785390059.431874:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879255936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785390059.432063:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879255936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390059.432078:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1785390059.432160:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879255936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1785390059.433608:0:11072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1785390059.433783:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1785390059.433804:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785390059.433813:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.433824:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390059.433834:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785390059.433843:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5111bb800 from 7 10000000:01000000:3.0:1785390059.433846:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785390059.433882:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.433891:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.433901:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390059.433921:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.433962:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390059.433994:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390059.434087:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256064 00000100:00100000:0.0:1785390059.434093:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256064 00000100:00100000:0.0:1785390059.434133:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1785390059.434140:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879256064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390059.434150:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390059.434161:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecd52 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390059.434180:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390059.434190:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390059.434198:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:0.0:1785390059.434234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879256064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390059.434240:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1785390059.434513:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390059.434545:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.434554:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390059.434594:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.434616:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390059.434637:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390059.434736:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256192 00000100:00100000:0.0:1785390059.434740:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256192 00000100:00100000:0.0:1785390059.434765:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1785390059.434771:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879256192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390059.435014:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879256192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390059.435041:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1785390059.436675:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.436716:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.436758:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390059.436784:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390059.436801:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256320 00000100:00100000:3.0:1785390059.436805:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256320 00000100:00100000:3.0:1785390059.436830:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1785390059.436835:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879256320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.436967:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879256320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390059.436973:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1785390059.437006:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785390059.437736:0:11073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1785390059.437783:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1785390059.437797:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785390059.437806:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.437816:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390059.437826:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785390059.437828:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf509225000 from 7 10000000:01000000:3.0:1785390059.437831:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785390059.437851:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.437859:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.437867:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390059.437881:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.437913:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390059.437926:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390059.437938:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256448 00000100:00100000:3.0:1785390059.437941:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256448 00000100:00100000:3.0:1785390059.437961:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1785390059.437966:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879256448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390059.437974:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390059.437984:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecd60 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.438001:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.438010:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.438017:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785390059.438041:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879256448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390059.438046:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1785390059.438073:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390059.438083:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.438090:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390059.441880:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.441936:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390059.441977:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4da80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390059.442197:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256576 00000100:00100000:2.0:1785390059.442204:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256576 00000100:00100000:2.0:1785390059.442244:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1785390059.442251:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879256576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390059.445838:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879256576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3581us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390059.445851:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1785390059.459259:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390059.459333:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785390059.459394:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390059.459426:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf502a67480 going to sleep for 11 seconds 00000100:00100000:3.0:1785390059.459619:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256704 00000100:00100000:3.0:1785390059.459625:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256704 00000100:00100000:3.0:1785390059.459673:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1785390059.459681:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879256704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390059.459851:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879256704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390059.459858:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1785390059.460000:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879256704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785390059.461502:0:11075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1785390059.461690:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1785390059.461707:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785390059.461716:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390059.461727:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390059.542293:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879256832:0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.542378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390059.542425:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256832 00000100:00100000:1.0:1785390059.542434:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256832 00000100:00100000:3.0:1785390059.542440:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879257344:0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.542476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390059.542492:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1785390059.542499:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785390059.542504:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879256960:0@lo:400:kworker.0 00000100:00100000:1.0:1785390059.542507:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.542541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390059.542568:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879257088:0@lo:400:kworker.0 00000100:00100000:1.0:1785390059.542573:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879256832:12345-0@lo:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390059.542580:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1785390059.542587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390059.542595:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879256960 00000100:00100000:1.0:1785390059.542599:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879256960 00000100:00100000:3.0:1785390059.542610:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390059.542615:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879257216:0@lo:400:kworker.0 00000100:00100000:1.0:1785390059.542624:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1785390059.542629:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879256960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.542634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390059.542654:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879256960:12345-0@lo:400:kworker.0 Request processed in 24us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390059.542659:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1785390059.542669:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257216 00000100:00100000:1.0:1785390059.542672:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257216 00000100:00100000:1.0:1785390059.542687:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1785390059.542692:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879257216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390059.542723:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879257216:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390059.542728:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1785390059.542742:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390059.543845:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257344 00000100:00100000:3.0:1785390059.543851:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257344 00000100:00100000:3.0:1785390059.543886:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257088 00000100:00100000:3.0:1785390059.543889:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257088 00000100:00100000:3.0:1785390059.543908:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785390059.543914:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879257344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.543947:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879257344:12345-0@lo:400:kworker.0 Request processed in 34us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390059.543953:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785390059.543964:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785390059.543969:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879257088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.543990:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879257088:12345-0@lo:400:kworker.0 Request processed in 21us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390059.543995:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785390059.544029:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879256960:0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.544039:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879256832:0@lo:400:kworker.0 00010000:00080000:3.0:1785390059.544050:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf511080700 x1872116879257344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390059.544060:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879257344:0@lo:400:kworker.0 00000100:00100000:3.0:1785390059.544088:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879257216:0@lo:400:kworker.0 00010000:00080000:3.0:1785390059.544096:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf511082a00 x1872116879257088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390059.545205:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879257088:0@lo:400:kworker.0 00000100:00080000:1.0:1785390059.550546:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785390059.550556:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785390059.989903:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390060.053843:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785390060.059771:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879257472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390060.059844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390060.060007:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257472 00000100:00100000:3.0:1785390060.060015:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257472 00000100:00100000:3.0:1785390060.060070:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1785390060.060079:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879257472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390060.060114:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390060.060158:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879257472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390060.060165:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1785390060.060227:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a891500 x1872116879257472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390060.060247:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879257472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390060.572888:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785390060.572910:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879257600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390060.572975:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390060.573034:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257600 00000100:00100000:0.0:1785390060.573041:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257600 00000100:00100000:0.0:1785390060.573082:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1785390060.573089:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879257600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390060.573121:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390060.573159:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879257600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390060.573165:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1785390060.573202:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535924a80 x1872116879257600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390060.573218:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879257600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785390061.014586:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390062.006558:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390062.006612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390062.006640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390062.006673:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756672 00000100:00100000:1.0:1785390062.006683:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756672 00000100:00100000:1.0:1785390062.006733:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756800 00000100:00100000:1.0:1785390062.006736:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756800 00000100:00100000:1.0:1785390062.006882:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:1.0:1785390062.006893:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847756672:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390062.006964:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847756672:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390062.006971:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:1.0:1785390062.006987:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1785390062.006994:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847756800:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390062.007015:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847756800:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390062.007021:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00080000:1.0:1785390062.007037:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390062.007627:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756544 00000100:00100000:3.0:1785390062.007632:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756544 00000100:00100000:3.0:1785390062.007660:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 261 00000100:00100000:3.0:1785390062.007666:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847756544:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390062.007698:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847756544:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 32us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390062.007704:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 261 00010000:00010000:3.0:1785390062.050689:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390063.061813:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785390063.370926:0:11236:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1785390064.085795:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390064.661899:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879257728:0@lo:400:kworker.0 00000100:00100000:2.0:1785390064.661972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390064.662037:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879258240:0@lo:400:kworker.0 00000100:00100000:2.0:1785390064.662074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390064.662101:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390064.662106:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879258112:0@lo:400:kworker.0 00000100:00100000:2.0:1785390064.662151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390064.662558:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257728 00000100:00100000:0.0:1785390064.662571:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257728 00000100:00100000:0.0:1785390064.662614:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1785390064.662623:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879257728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390064.662674:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879257728:12345-0@lo:400:kworker.0 Request processed in 52us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390064.662681:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1785390064.662768:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879257856:0@lo:400:kworker.0 00000100:00100000:3.0:1785390064.662798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390064.662827:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879258368:0@lo:400:kworker.0 00000100:00100000:3.0:1785390064.662849:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390064.662878:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785390064.662891:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879257984:0@lo:400:kworker.0 00000100:00100000:3.0:1785390064.662917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390064.662948:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258112 00000100:00100000:3.0:1785390064.662952:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258112 00000100:00100000:3.0:1785390064.662983:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258368 00000100:00100000:3.0:1785390064.662987:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258368 00000100:00100000:3.0:1785390064.663017:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1785390064.663024:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879258112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390064.663057:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879258112:12345-0@lo:400:kworker.0 Request processed in 34us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390064.663063:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1785390064.663088:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785390064.663095:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879258368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390064.663101:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258240 00000100:00100000:1.0:1785390064.663105:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258240 00000100:00100000:3.0:1785390064.663127:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879258368:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390064.663132:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785390064.663132:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257856 00000100:00100000:1.0:1785390064.663135:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257856 00000100:00100000:1.0:1785390064.663145:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879257984 00000100:00100000:1.0:1785390064.663147:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879257984 00000100:00100000:3.0:1785390064.663151:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1785390064.663157:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879258240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390064.663159:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1785390064.663164:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879257856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390064.663186:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879258240:12345-0@lo:400:kworker.0 Request processed in 29us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390064.663190:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879257856:12345-0@lo:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390064.663192:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1785390064.663195:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1785390064.663204:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1785390064.663209:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879257984:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785390064.663216:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785390064.663220:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785390064.663222:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390064.663233:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879257984:12345-0@lo:400:kworker.0 Request processed in 24us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390064.663238:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1785390064.663278:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879257984:0@lo:400:kworker.0 00000100:00100000:3.0:1785390064.663287:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879257856:0@lo:400:kworker.0 00010000:00080000:3.0:1785390064.663297:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e151500 x1872116879258368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390064.663307:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879258368:0@lo:400:kworker.0 00010000:00080000:2.0:1785390064.663972:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e152d80 x1872116879258112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390064.663984:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879258112:0@lo:400:kworker.0 00000100:00100000:2.0:1785390064.663993:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879257728:0@lo:400:kworker.0 00000100:00100000:2.0:1785390064.664025:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879258240:0@lo:400:kworker.0 00010000:00010000:1.0:1785390065.111956:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390065.175698:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785390065.175725:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879258496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390065.175798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390065.176080:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258496 00000100:00100000:1.0:1785390065.176089:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258496 00000100:00100000:1.0:1785390065.176139:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785390065.176148:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879258496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390065.176181:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390065.176232:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879258496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390065.176238:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1785390065.176309:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a891180 x1872116879258496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390065.176325:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879258496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390065.688880:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390065.688902:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879258624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390065.688967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390065.689083:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258624 00000100:00100000:0.0:1785390065.689091:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258624 00000100:00100000:0.0:1785390065.689139:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1785390065.689148:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879258624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390065.689181:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390065.689225:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879258624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390065.689232:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1785390065.690294:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e151c00 x1872116879258624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390065.690314:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879258624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785390066.135685:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390067.121654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390067.121691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390067.121716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390067.121738:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847757184 00000100:00100000:1.0:1785390067.121747:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847757184 00000100:00100000:1.0:1785390067.121797:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847757056 00000100:00100000:1.0:1785390067.121800:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847757056 00000100:00100000:1.0:1785390067.121821:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:1.0:1785390067.121829:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2360:x1872116847757184:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390067.121891:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2360:x1872116847757184:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390067.121899:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:1.0:1785390067.121914:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00100000:1.0:1785390067.121920:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847757056:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390067.121940:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847757056:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 20us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390067.121956:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00080000:1.0:1785390067.121970:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390067.122231:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847756928 00000100:00100000:3.0:1785390067.122236:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847756928 00000100:00100000:3.0:1785390067.122270:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 263 00000100:00100000:3.0:1785390067.122277:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847756928:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390067.122309:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847756928:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390067.122315:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 263 00010000:00010000:1.0:1785390067.157794:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390068.181965:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390069.231610:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1785390069.360908:0:11336:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:41:06 (1785390066) === 00000100:00100000:2.0:1785390069.781908:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879258880:0@lo:400:kworker.0 00000100:00100000:2.0:1785390069.781990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390069.782053:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879258752:0@lo:400:kworker.0 00000100:00100000:2.0:1785390069.782102:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785390069.782113:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879259008:0@lo:400:kworker.0 00000100:00100000:3.0:1785390069.782177:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258880 00000100:00100000:3.0:1785390069.782188:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258880 00000100:00100000:3.0:1785390069.782238:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1785390069.782246:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879258880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390069.782295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390069.793298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390069.793413:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259008 00000100:00100000:2.0:1785390069.793426:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259008 00000100:00080000:0.0:1785390069.793584:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390069.793688:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1785390069.793701:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879259008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390069.793768:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879259008:12345-0@lo:400:kworker.0 Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390069.793777:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1785390069.793920:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879259136:0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.793968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390069.794004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390069.794010:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879259264:0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794033:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390069.794060:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259264 00000100:00100000:0.0:1785390069.794063:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259264 00000100:00100000:0.0:1785390069.794087:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1785390069.794092:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879259264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794145:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879259264:12345-0@lo:400:kworker.0 Request processed in 52us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390069.794151:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1785390069.794170:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390069.794202:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879259264:0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794228:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879259392:0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794250:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390069.794277:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879259008:0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794296:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259136 00000100:00100000:0.0:1785390069.794299:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259136 00000100:00100000:0.0:1785390069.794326:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259392 00000100:00100000:0.0:1785390069.794328:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259392 00000100:00100000:0.0:1785390069.794344:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785390069.794349:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879259136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794393:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879259136:12345-0@lo:400:kworker.0 Request processed in 43us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390069.794399:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785390069.794410:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1785390069.794415:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879259392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390069.794441:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879259392:12345-0@lo:400:kworker.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390069.794447:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1785390069.794464:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390069.794467:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1785390069.794483:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5411a7100 x1872116879259136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390069.794623:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879259136:0@lo:400:kworker.0 00010000:00080000:0.0:1785390069.794650:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf5411a4000 x1872116879259392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390069.794659:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879259392:0@lo:400:kworker.0 00000100:00100000:3.0:1785390069.794967:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879258880:12345-0@lo:400:kworker.0 Request processed in 12712us (12967us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390069.794979:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1785390069.796039:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879258880:0@lo:400:kworker.0 00000100:00100000:1.0:1785390069.804479:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879258752 00000100:00100000:1.0:1785390069.804492:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879258752 00000100:00100000:1.0:1785390069.804788:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1785390069.804799:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879258752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390069.804865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879258752:12345-0@lo:400:kworker.0 Request processed in 69us (22734us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390069.804872:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1785390069.804945:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879258752:0@lo:400:kworker.0 00000100:00100000:1.0:1785390069.838839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390069.838900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390069.839028:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847757440 00000100:00100000:0.0:1785390069.839041:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847757440 00000100:00100000:0.0:1785390069.839126:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1785390069.839146:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:9669:x1872116847757440:12345-192.168.202.54@tcp:700:mkdir.0 00000100:00100000:0.0:1785390069.839242:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:9669:x1872116847757440:12345-192.168.202.54@tcp:700:mkdir.0 Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390069.839250:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00080000:1.0:1785390069.839722:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390069.843087:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847757312 00000100:00100000:2.0:1785390069.843098:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847757312 00000100:00100000:2.0:1785390069.843184:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785390069.843194:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847757312:12345-192.168.202.54@tcp:41:mkdir.0 00000004:00000024:2.0:1785390069.843243:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785390069.843518:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847757312:12345-192.168.202.54@tcp:41:mkdir.0 Request processed in 317us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390069.843577:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1785390069.848100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390069.854864:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847757696 00000100:00100000:3.0:1785390069.854884:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847757696 00000100:00100000:3.0:1785390069.854968:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1785390069.854981:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:9669:x1872116847757696:12345-192.168.202.54@tcp:36:mkdir.0 00010000:00010000:3.0:1785390069.855057:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390069.855092:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecc4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be7c expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.868819:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:3.0:1785390069.868846:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390069.870057:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.870080:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.870094:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.870107:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.870114:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.870121:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390069.875207:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785390069.875230:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.875241:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.875249:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.875254:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390069.875259:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.875274:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.875291:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:2.0:1785390069.875294:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390069.875299:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.875304:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390069.875324:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000640577d8 reply state 00000000808048cd transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390069.875333:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390069.875463:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9669:x1872116847757696:12345-192.168.202.54@tcp:36:mkdir.0 Request processed in 20480us (27368us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1785390069.875474:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:3.0:1785390069.887794:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.887811:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.887818:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.887824:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390069.887828:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.887834:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.887850:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf50629b200) 00010000:00010000:3.0:1785390069.887853:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390069.887856:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.887878:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ecd75 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390069.892990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390069.893286:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847757824 00000100:00100000:3.0:1785390069.893299:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847757824 00000100:00100000:3.0:1785390069.893381:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1785390069.893394:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:9671:x1872116847757824:12345-192.168.202.54@tcp:101:chmod.0 00010000:00010000:3.0:1785390069.893425:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390069.893456:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecd7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf01 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.893592:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ecd83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.893609:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ecd83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.893623:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ecd83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390069.893699:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1785390069.893704:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390069.893750:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ecd83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.893781:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecd7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf01 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.893803:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ecd83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf01 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.893828:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:3.0:1785390069.893831:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390069.893835:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785390069.893906:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9671:x1872116847757824:12345-192.168.202.54@tcp:101:chmod.0 Request processed in 515us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390069.893913:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1785390069.910445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390069.910636:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847758080 00000100:00100000:1.0:1785390069.910646:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847758080 00000100:00100000:1.0:1785390069.910700:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1785390069.910708:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9671:x1872116847758080:12345-192.168.202.54@tcp:36:chmod.0 00010000:00010000:1.0:1785390069.910768:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390069.910795:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ecd83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf01 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390069.910831:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:1.0:1785390069.910842:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390069.910873:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390069.910885:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390069.910894:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390069.911186:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d180ae97 reply state 000000005ff92579 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390069.911196:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1785390069.911208:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1785390069.911284:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:9671:x1872116847758080:12345-192.168.202.54@tcp:36:chmod.0 Request processed in 576us (846us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1785390069.911291:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00010000:00010000:2.0:1785390069.925788:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.925804:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.925811:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.925816:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390069.925820:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.925839:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.925853:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf510c5a000) 00010000:00010000:2.0:1785390069.925855:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785390069.925860:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.925866:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ecd8a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390069.965077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390069.967099:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847758208 00000100:00100000:2.0:1785390069.967124:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847758208 00000100:00100000:2.0:1785390069.967265:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1785390069.967288:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9672:x1872116847758208:12345-192.168.202.54@tcp:101:chown.0 00010000:00010000:2.0:1785390069.967313:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390069.967338:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf08 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.967419:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecd98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.967433:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecd98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.967445:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecd98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390069.967515:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785390069.967520:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390069.967624:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecd98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.967652:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecd91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf08 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.967670:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecd98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf08 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390069.967678:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:2.0:1785390069.967681:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390069.967684:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d000, rc 0) 00000100:00100000:2.0:1785390069.967763:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:9672:x1872116847758208:12345-192.168.202.54@tcp:101:chown.0 Request processed in 489us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390069.967769:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:1.0:1785390069.978941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390069.979586:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847758336 00000100:00100000:3.0:1785390069.979596:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847758336 00000100:00100000:3.0:1785390069.979680:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1785390069.979690:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:9672:x1872116847758336:12345-192.168.202.54@tcp:101:chown.0 00010000:00010000:3.0:1785390069.979710:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390069.979729:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecd9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979785:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979798:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979808:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979821:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979828:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979851:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979949:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ecdb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979956:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ecdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.979963:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ecdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390069.979997:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1785390069.980000:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390069.980022:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ecdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980032:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980039:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980046:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980052:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390069.980055:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980063:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980079:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:3.0:1785390069.980082:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390069.980086:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980092:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ecda6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980115:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980120:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980126:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980132:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390069.980134:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980140:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980146:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf520a1d300) 00010000:00010000:3.0:1785390069.980148:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390069.980151:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980156:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ecdad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980192:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecd9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf0f expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980204:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ecdb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf0f expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.980212:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390069.980214:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390069.980216:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5000, rc 0) 00000100:00100000:3.0:1785390069.980273:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:9672:x1872116847758336:12345-192.168.202.54@tcp:101:chown.0 Request processed in 585us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390069.980612:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1785390069.996897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390069.996983:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847758592 00000100:00100000:3.0:1785390069.996992:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847758592 00000100:00100000:3.0:1785390069.997053:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1785390069.997064:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:9672:x1872116847758592:12345-192.168.202.54@tcp:36:chown.0 00010000:00010000:3.0:1785390069.997135:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390069.997162:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ecdb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf0f expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.997181:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390069.997191:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390069.997216:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.997229:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390069.997255:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785390070.085042:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099fe03dc reply state 00000000decdcef9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390070.085060:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1785390070.085205:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1785390070.085326:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:9672:x1872116847758592:12345-192.168.202.54@tcp:36:chown.0 Request processed in 88259us (88434us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1785390070.085335:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000001:00080000:2.0:1785390070.085881:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1785390070.085905:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1785390070.095192:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.095211:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.095219:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.095224:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390070.095230:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.095237:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.095253:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf520a1d300) 00010000:00010000:3.0:1785390070.095256:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785390070.095261:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.095296:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ecdbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390070.106966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390070.107099:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847758720 00000100:00100000:2.0:1785390070.107115:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847758720 00000100:00100000:2.0:1785390070.107175:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1785390070.107186:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:9673:x1872116847758720:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:2.0:1785390070.107210:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390070.107232:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecdc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf16 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785390070.110744:0:5803:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3459us 00010000:00010000:1.0:1785390070.145738:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.145762:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.145775:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.145800:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.145808:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.145815:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.148858:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ecdd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.148875:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ecdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.148885:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ecdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390070.148980:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785390070.148984:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390070.149080:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ecdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149095:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149101:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149109:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149224:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390070.149229:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149238:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149250:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:1.0:1785390070.149253:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390070.149258:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149263:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecdc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149275:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149282:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149287:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149292:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390070.149295:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149300:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149319:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390070.149321:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390070.149324:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149330:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ecdd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149380:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ecdc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf16 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149396:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ecdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf16 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.149403:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:1.0:1785390070.149405:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785390070.149408:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5a00, rc 0) 00000100:00100000:1.0:1785390070.149487:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9673:x1872116847758720:12345-192.168.202.54@tcp:101:touch.500 Request processed in 42302us (42528us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390070.149497:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1785390070.160222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390070.160853:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847758976 00000100:00100000:0.0:1785390070.160863:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847758976 00000100:00100000:0.0:1785390070.160970:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1785390070.160981:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9673:x1872116847758976:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:0.0:1785390070.161001:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390070.161024:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716400/0x33dffe75ff5ecdde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf1d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.161444:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.161464:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.161478:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.161494:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.161501:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.161508:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785390070.163496:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1785390070.164211:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecdf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164226:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164237:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164270:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164278:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164285:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164298:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390070.164302:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164310:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164322:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:0.0:1785390070.164325:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390070.164330:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164336:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ecde5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390070.164347:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d82d47f5 reply state 00000000e4019c1a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390070.164356:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1785390070.164398:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716400/0x33dffe75ff5ecdde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf1d expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164413:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf1d expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.164420:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf50896cd00) 00010000:00010000:0.0:1785390070.164422:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390070.164424:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:0.0:1785390070.164498:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:9673:x1872116847758976:12345-192.168.202.54@tcp:101:touch.500 Request processed in 3518us (4284us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1785390070.164513:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00010000:00010000:2.0:1785390070.169096:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.169142:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.169150:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.169156:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390070.169161:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.169169:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.169184:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff8cf50896c700) 00010000:00010000:2.0:1785390070.169187:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390070.169191:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.169198:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecdec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390070.174032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390070.174622:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847759232 00000100:00100000:1.0:1785390070.174634:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847759232 00000100:00100000:1.0:1785390070.174703:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1785390070.174714:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:9673:x1872116847759232:12345-192.168.202.54@tcp:36:touch.500 00010000:00010000:1.0:1785390070.174771:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390070.174797:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecdf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf1d expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.174845:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf50896cd00) 00010000:00010000:1.0:1785390070.174857:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390070.174897:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.174909:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.174917:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390070.175039:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008afc801f reply state 00000000415f31ea transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390070.175048:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390070.175140:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:9673:x1872116847759232:12345-192.168.202.54@tcp:36:touch.500 Request processed in 427us (1116us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1785390070.175147:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00010000:00010000:0.0:1785390070.177681:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.177695:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.177703:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.177721:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4800 already unused, calling callback (ffffffffc1fe14f0) 00000100:00100000:3.0:1785390070.177724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:0.0:1785390070.177727:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.177737:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.177752:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:0.0:1785390070.177754:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390070.177760:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.177766:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ece01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390070.177768:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847759360 00000100:00100000:3.0:1785390070.177782:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847759360 00000100:00100000:3.0:1785390070.177838:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1785390070.177847:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:9673:x1872116847759360:12345-192.168.202.54@tcp:101:touch.500 00010000:00010000:3.0:1785390070.177873:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390070.177893:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ece08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf24 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.177953:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ece08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf24 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.177969:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ece08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf24 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.177989:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf520a1d300) 00010000:00010000:3.0:1785390070.177992:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390070.177996:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5a00, rc 0) 00000100:00100000:3.0:1785390070.178049:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:9673:x1872116847759360:12345-192.168.202.54@tcp:101:touch.500 Request processed in 201us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390070.178056:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1785390070.183837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390070.183947:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847759488 00000100:00100000:0.0:1785390070.183961:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847759488 00000100:00100000:0.0:1785390070.184023:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1785390070.184033:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1872116847759488:12345-192.168.202.54@tcp:8:touch.500 00010000:00080000:0.0:1785390070.184076:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:0.0:1785390070.184147:0:6599:0:(genops.c:1406:class_connect()) connect: client db9e37b8-1bb4-4113-a95f-cdba66461e5f, cookie 0x33dffe75ff5ece0f 00002000:00100000:0.0:1785390070.184162:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db9e37b8-1bb4-4113-a95f-cdba66461e5f/ffff8cf51f0e4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785390070.184193:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785390070.184783:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785390070.184823:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390070.184907:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2356:x1872116847759488:12345-192.168.202.54@tcp:8:touch.500 Request processed in 874us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390070.184916:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1785390070.188061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390070.190059:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847759616 00000100:00100000:2.0:1785390070.190073:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847759616 00000100:00100000:2.0:1785390070.190140:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1785390070.190152:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:0:x1872116847759616:12345-192.168.202.54@tcp:2:touch.500 00000100:00080000:1.0:1785390070.190848:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1785390070.233045:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1785390070.264685:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000001:00080000:3.0:1785390070.264731:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1785390070.265197:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:0:x1872116847759616:12345-192.168.202.54@tcp:2:touch.500 Request processed in 75040us (77137us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1785390070.265209:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1785390070.273215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390070.274071:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847759872 00000100:00100000:2.0:1785390070.274086:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847759872 00000100:00100000:2.0:1785390070.274167:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:2.0:1785390070.274180:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:9673:x1872116847759872:12345-192.168.202.54@tcp:35:touch.500 00000100:00100000:0.0:1785390070.274805:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+11:9673:x1872116847759872:12345-192.168.202.54@tcp:35:touch.500 Request processed in 619us (1594us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1785390070.274818:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1785390070.297452:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879259520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390070.297517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390070.297696:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259520 00000100:00100000:1.0:1785390070.297705:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259520 00000100:00100000:1.0:1785390070.297742:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785390070.297749:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879259520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390070.297770:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390070.297818:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879259520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390070.297824:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1785390070.298085:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50de81180 x1872116879259520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390070.298102:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879259520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390070.305222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390070.305573:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847760000 00000100:00100000:1.0:1785390070.305584:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847760000 00000100:00100000:1.0:1785390070.305627:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785390070.305635:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+11:9674:x1872116847760000:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:1.0:1785390070.305657:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390070.305676:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ece16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf2b expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.305742:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.305757:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.305768:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390070.305823:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1785390070.305827:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390070.305864:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.305890:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ece16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf2b expref: 13 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.305908:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf2b expref: 12 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.305916:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:1.0:1785390070.305919:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390070.305935:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4c00, rc 0) 00000100:00100000:1.0:1785390070.305991:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:9674:x1872116847760000:12345-192.168.202.54@tcp:101:rm.0 Request processed in 356us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390070.305998:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785390070.314928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390070.315042:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847760256 00000100:00100000:3.0:1785390070.315051:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847760256 00000100:00100000:3.0:1785390070.315105:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:3.0:1785390070.315114:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:9674:x1872116847760256:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:3.0:1785390070.315142:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390070.315161:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf32 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390070.315262:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1785390070.315421:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf32 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.315436:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:3.0:1785390070.315439:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390070.315443:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf32 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.315457:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5000, rc 0) 00000100:00100000:3.0:1785390070.315861:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:9674:x1872116847760256:12345-192.168.202.54@tcp:101:rm.0 Request processed in 746us (943us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1785390070.315868:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1785390070.339329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390070.339440:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847760384 00000100:00100000:0.0:1785390070.339450:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847760384 00000100:00100000:0.0:1785390070.339518:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1785390070.339549:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:9674:x1872116847760384:12345-192.168.202.54@tcp:37:rm.0 00000100:00100000:1.0:1785390070.353065:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:9674:x1872116847760384:12345-192.168.202.54@tcp:37:rm.0 Request processed in 13508us (13736us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390070.353082:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:3.0:1785390070.394047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390070.394149:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847760640 00000100:00100000:0.0:1785390070.394158:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847760640 00000100:00100000:0.0:1785390070.394212:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1785390070.394221:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5087c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:9674:x1872116847760640:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:0.0:1785390070.394461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5087c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:9674:x1872116847760640:12345-192.168.202.54@tcp:35:rm.0 Request processed in 240us (423us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1785390070.394468:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1785390070.407605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390070.407706:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847760896 00000100:00100000:2.0:1785390070.407715:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847760896 00000100:00100000:2.0:1785390070.407761:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1785390070.407768:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:9674:x1872116847760896:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1785390070.407791:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390070.407809:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf39 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.407932:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ece39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.407947:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ece39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.407960:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ece39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390070.407970:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1785390070.408132:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf39 expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.408148:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ece39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf39 expref: 16 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.408156:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:2.0:1785390070.408164:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785390070.408168:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d200, rc 0) 00000100:00100000:2.0:1785390070.408226:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847760896:12345-192.168.202.54@tcp:101:rm.0 Request processed in 458us (631us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1785390070.408233:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1785390070.415332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390070.415616:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847761024 00000100:00100000:0.0:1785390070.415625:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847761024 00000100:00100000:0.0:1785390070.415674:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1785390070.415950:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847761024:12345-192.168.202.54@tcp:41:rm.0 00000004:00000024:0.0:1785390070.416021:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1785390070.416127:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847761024:12345-192.168.202.54@tcp:41:rm.0 Request processed in 444us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390070.416136:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1785390070.444294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390070.444438:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847761152 00000100:00100000:2.0:1785390070.444448:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847761152 00000100:00100000:2.0:1785390070.444521:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1785390070.444547:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847761152:12345-192.168.202.54@tcp:101:rm.0 00010000:00010000:2.0:1785390070.444574:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390070.444593:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf40 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444647:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444660:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444670:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444691:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444697:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444703:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.444817:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445358:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445374:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390070.445401:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785390070.445406:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390070.445421:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445432:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445440:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445448:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445454:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445460:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390070.445464:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445576:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445595:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:2.0:1785390070.445597:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390070.445602:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445607:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ece4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445618:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445623:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445628:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445632:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390070.445634:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445639:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445644:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff8cf50629b300) 00010000:00010000:2.0:1785390070.445646:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390070.445648:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445653:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ece55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445770:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf40 expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445783:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf40 expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.445791:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf520a1d300) 00010000:00010000:2.0:1785390070.445881:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390070.445885:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121de00, rc 0) 00000100:00100000:2.0:1785390070.445952:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:9674:x1872116847761152:12345-192.168.202.54@tcp:101:rm.0 Request processed in 1405us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390070.445958:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1785390070.458097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390070.465979:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847761408 00000100:00100000:3.0:1785390070.465992:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847761408 00000100:00100000:3.0:1785390070.466056:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1785390070.466065:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:9674:x1872116847761408:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:3.0:1785390070.466112:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785390070.466137:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ece5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf40 expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466157:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5a00/0x33dffe75ff5ece08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf24 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466168:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf520a1d300) 00010000:00010000:3.0:1785390070.466183:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf2b expref: 15 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466190:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:3.0:1785390070.466194:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390070.466210:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466222:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466229:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466254:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466261:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466266:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466395:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466403:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390070.466413:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785390070.468436:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1785390070.468449:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379022924177ns, next at 380022921767ns, rc = 0 00010000:00010000:2.0:1785390070.469014:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469028:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469038:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469046:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469053:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469059:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469089:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390070.469108:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469115:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469122:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469127:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390070.469131:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469138:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469148:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390070.469150:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1785390070.469155:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469160:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ece71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469175:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469181:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469187:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469197:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390070.469199:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469206:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469212:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:2.0:1785390070.469215:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390070.469217:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390070.469222:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ece63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390070.469231:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb774f5d reply state 00000000c3cf728f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390070.469239:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390070.469322:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847761408:12345-192.168.202.54@tcp:36:rm.0 Request processed in 3254us (11230us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1785390070.469330:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00010000:00010000:1.0:1785390070.469961:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390070.469969:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.469975:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390070.469978:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.469985:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.469994:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390070.469996:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785390070.469999:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.470005:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ece78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.470020:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390070.470028:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390070.470030:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390070.474581:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.474598:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.474606:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.474612:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390070.474616:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.474623:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.474638:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff8cf520a1d700) 00010000:00010000:1.0:1785390070.474641:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390070.474645:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.474652:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ece6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390070.477498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390070.477566:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847761664 00000100:00100000:3.0:1785390070.477577:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847761664 00000100:00100000:3.0:1785390070.477630:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1785390070.477640:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:9674:x1872116847761664:12345-192.168.202.54@tcp:35:rm.0 00000100:00100000:3.0:1785390070.477981:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847761664:12345-192.168.202.54@tcp:35:rm.0 Request processed in 341us (490us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785390070.477988:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1785390070.483042:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390070.483584:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847761920 00000100:00100000:1.0:1785390070.483595:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847761920 00000100:00100000:1.0:1785390070.483647:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:1.0:1785390070.483656:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:9674:x1872116847761920:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1785390070.483715:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785390070.483753:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ece39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf39 expref: 16 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483776:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ecdd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf16 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483788:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:1.0:1785390070.483802:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecd98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf08 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483811:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:1.0:1785390070.483818:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390070.483840:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483852:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483862:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483936:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483946:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.483954:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.484241:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.484254:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.484262:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390070.492541:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1785390070.492573:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492585:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492593:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492599:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390070.492604:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492612:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492627:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:1.0:1785390070.492630:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785390070.492634:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492640:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ece8d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492667:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492689:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492694:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492699:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390070.492702:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492708:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492717:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf510c5ab00) 00010000:00010000:1.0:1785390070.492719:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390070.492722:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390070.492728:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4000/0x33dffe75ff5ece7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390070.492741:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e52fd4e reply state 00000000f668ee0a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390070.492751:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390070.492847:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:9674:x1872116847761920:12345-192.168.202.54@tcp:36:rm.0 Request processed in 9187us (9809us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1785390070.492856:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00010000:00010000:0.0:1785390070.501445:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.501464:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.501473:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.501479:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390070.501493:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.501502:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.501518:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf510c5a000) 00010000:00010000:0.0:1785390070.501549:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390070.501555:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390070.501561:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4e00/0x33dffe75ff5ece86 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390070.812652:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390070.812672:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879259648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390070.812759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390070.812919:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259648 00000100:00100000:0.0:1785390070.812928:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259648 00000100:00100000:0.0:1785390070.812990:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1785390070.812997:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879259648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390070.813031:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390070.813078:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879259648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390070.813084:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1785390070.813182:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e153b80 x1872116879259648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390070.813199:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879259648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785390071.254045:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390072.246698:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390072.246739:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390072.246761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390072.246785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390072.246817:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762176 00000100:00100000:0.0:1785390072.246829:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762176 00000100:00100000:0.0:1785390072.246896:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762432 00000100:00100000:0.0:1785390072.246900:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762432 00000100:00100000:0.0:1785390072.246928:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:0.0:1785390072.246939:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2360:x1872116847762176:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390072.247036:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2360:x1872116847762176:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 98us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390072.247044:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:0.0:1785390072.247063:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:0.0:1785390072.247069:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847762432:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390072.247094:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847762432:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390072.247100:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:0.0:1785390072.247121:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762304 00000100:00100000:0.0:1785390072.247125:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762304 00000100:00100000:0.0:1785390072.247173:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:0.0:1785390072.247179:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847762304:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390072.247206:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847762304:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390072.247213:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00080000:0.0:1785390072.247228:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390072.247234:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390072.251485:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762048 00000100:00100000:3.0:1785390072.251573:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762048 00000100:00100000:3.0:1785390072.251645:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 265 00000100:00100000:3.0:1785390072.251655:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847762048:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390072.251758:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847762048:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 103us (5072us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390072.251767:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 265 00010000:00010000:1.0:1785390072.281113:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390073.306859:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390074.331849:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390074.928655:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390074.928683:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879259904:0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.928774:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390074.928875:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879260032:0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.928901:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390074.928974:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390074.928981:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879260416:0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.929012:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390074.929086:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259904 00000100:00100000:3.0:1785390074.929095:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259904 00000100:00100000:3.0:1785390074.929150:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260032 00000100:00100000:3.0:1785390074.929153:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260032 00000100:00100000:1.0:1785390074.929441:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879259776:0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.929483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390074.929541:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879260288:0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.929568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390074.929582:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390074.929587:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879260160:0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.929610:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390074.929640:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879259776 00000100:00100000:1.0:1785390074.929644:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879259776 00000100:00100000:1.0:1785390074.929677:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1785390074.929686:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879259776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.929741:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879259776:12345-0@lo:400:kworker.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390074.929750:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1785390074.929788:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260416 00000100:00100000:1.0:1785390074.929791:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260416 00000100:00100000:1.0:1785390074.929818:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260160 00000100:00100000:1.0:1785390074.929821:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260160 00000100:00100000:1.0:1785390074.929844:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785390074.929850:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879260416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.929911:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879260416:12345-0@lo:400:kworker.0 Request processed in 60us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390074.929918:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785390074.929930:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1785390074.929936:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879260160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.930110:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260288 00000100:00100000:3.0:1785390074.930114:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260288 00000100:00100000:3.0:1785390074.930139:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1785390074.930146:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879259904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.930180:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879259904:12345-0@lo:400:kworker.0 Request processed in 35us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390074.930610:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879260160:12345-0@lo:400:kworker.0 Request processed in 673us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390074.930618:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1785390074.930657:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535b11180 x1872116879260160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390074.930673:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879260160:0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.930682:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879259776:0@lo:400:kworker.0 00010000:00080000:1.0:1785390074.930720:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf51f10c000 x1872116879260416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390074.930729:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879260416:0@lo:400:kworker.0 00000100:00100000:1.0:1785390074.930739:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879259904:0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.931634:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1785390074.931655:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1785390074.931675:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879260032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.931733:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879260032:12345-0@lo:400:kworker.0 Request processed in 60us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390074.931739:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1785390074.931752:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1785390074.931759:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879260288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390074.931799:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879260288:12345-0@lo:400:kworker.0 Request processed in 41us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390074.931805:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1785390074.931855:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785390074.931860:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390074.931864:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390074.933158:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879260288:0@lo:400:kworker.0 00000100:00100000:2.0:1785390074.934651:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879260032:0@lo:400:kworker.0 00010000:00010000:1.0:1785390075.363222:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785390075.435512:0:7757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383989984505ns, next at 384989981293ns, rc = 0 00000100:00100000:2.0:1785390075.444729:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879260544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390075.444842:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390075.444939:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260544 00000100:00100000:2.0:1785390075.444965:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260544 00000100:00100000:2.0:1785390075.453119:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785390075.453151:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879260544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390075.453213:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390075.453314:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879260544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (8472us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390075.453333:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1785390075.453735:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a357480 x1872116879260544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390075.453761:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879260544:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1785390075.589187:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:1.0:1785390075.589207:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1785390075.589225:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1785390075.589493:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879260672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785390075.589594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390075.589663:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260672 00000100:00100000:3.0:1785390075.589671:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260672 00000100:00100000:3.0:1785390075.589717:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785390075.589726:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879260672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1785390075.589774:0:7936:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1785390075.589807:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a6ae3f6, atime: 0x6a6ae3f6, ctime: 0x6a6ae3f6, blocks: 0x1 00010000:00010000:3.0:1785390075.589815:0:7936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.589830:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1785390075.589835:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390075.589842:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.589870:0:7936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.589881:0:7936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.589888:0:7936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.589904:0:7936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785390075.591295:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879260672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1567us (1697us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1785390075.591304:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1785390075.591341:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390075.591348:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.591356:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5a00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390075.591361:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.591370:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.591387:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.591401:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b79101e/0x33dffe75ff5ece94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390075.591417:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390075.591419:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390075.591420:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785390075.591663:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf51f10dc00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1785390075.591670:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879260672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1785390075.925825:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879260800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390075.925899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390075.926021:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260800 00000100:00100000:0.0:1785390075.926030:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260800 00000100:00100000:0.0:1785390075.926085:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785390075.926094:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879260800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390075.926128:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390075.926179:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879260800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390075.926186:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1785390075.926225:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a357480 x1872116879260800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390075.926242:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879260800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390076.374974:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390077.359279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390077.359333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390077.359366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390077.359395:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762688 00000100:00100000:3.0:1785390077.359406:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762688 00000100:00100000:0.0:1785390077.359417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390077.359473:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762944 00000100:00100000:2.0:1785390077.359476:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762560 00000100:00100000:3.0:1785390077.359477:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762944 00000100:00100000:2.0:1785390077.359479:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762560 00000100:00100000:3.0:1785390077.359501:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:2.0:1785390077.359507:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 267 00000100:00100000:3.0:1785390077.359510:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847762688:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390077.359513:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847762560:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390077.359639:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:0.0:1785390077.359650:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847762944:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390077.359719:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847762688:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 208us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390077.359726:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00080000:3.0:1785390077.359752:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390077.359957:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847762816 00000100:00100000:1.0:1785390077.359961:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847762816 00000100:00100000:1.0:1785390077.359999:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:1.0:1785390077.360007:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847762816:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390077.366689:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847762560:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 6945us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390077.366705:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 267 00000100:00100000:0.0:1785390077.368512:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847762944:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 8858us (9139us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390077.368537:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00080000:2.0:1785390077.368616:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390077.384434:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847762816:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24416us (25004us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390077.384450:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00010000:00010000:3.0:1785390077.397682:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785390077.541923:0:11486:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1785390078.425013:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1785390079.266820:0:11535:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc9ba7980 20000000:00000080:1.0:1785390079.279886:0:11535:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf53a7bd000 uarg=0000000000000000 20000000:01000000:1.0:1785390079.279965:0:11535:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1785390079.279973:0:11535:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1785390079.279981:0:11535:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1785390079.283084:0:11536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1785390079.283258:0:11535:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1785390079.297354:0:11535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1785390079.299912:0:11535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1785390079.300048:0:11535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1785390079.300080:0:11535:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1785390079.300104:0:11535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300126:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300135:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300153:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300159:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300165:0:11535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300174:0:11535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300225:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300244:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 18 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.300262:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879260928:0@lo:104: 00000100:00100000:2.0:1785390079.300359:0:11535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785390079.300658:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300667:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 18 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.300677:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261056:0@lo:104: 00000100:00100000:2.0:1785390079.300703:0:11535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785390079.300836:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.300851:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 18 pid: 5797 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.300859:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261184:0@lo:104: 00000100:00100000:2.0:1785390079.300892:0:11535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1785390079.321931:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.321960:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 12 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.321981:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261312:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390079.322082:0:11535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.322091:0:11535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 12 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.322100:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261440:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390079.322125:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508e9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390079.341994:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879260928 00000100:00100000:0.0:1785390079.342010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390079.342015:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879260928 00000100:00100000:0.0:1785390079.342059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390079.342119:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763072 00000100:00100000:3.0:1785390079.342126:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763072 00000100:00100000:0.0:1785390079.342138:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879261056 00000100:00100000:0.0:1785390079.342147:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879261056 00000100:00100000:0.0:1785390079.342164:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879261184 00000100:00100000:0.0:1785390079.342168:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879261184 00000100:00100000:0.0:1785390079.342186:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785390079.342202:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:11535:x1872116879260928:12345-0@lo:104: 00010000:00010000:3.0:1785390079.342220:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 13 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.342221:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390079.342304:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763200 00000100:00100000:0.0:1785390079.342317:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1785390079.342329:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763200 00000100:00100000:0.0:1785390079.342330:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847763072:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390079.342345:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390079.342355:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 14 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390079.342359:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 14 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.342381:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 14 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.342401:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390079.342512:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1785390079.342558:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfce36af-778b-4771-80c2-03c6feec7bb9+14:2360:x1872116847763200:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390079.342575:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390079.342583:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 14 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390079.342597:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 14 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390079.342617:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390079.342627:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+14:2360:x1872116847763072:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 298us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390079.342637:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1785390079.342667:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847763200:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 143us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390079.342677:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00010000:00010000:0.0:1785390079.342830:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785390079.342838:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+5:11535:x1872116879260928:12345-0@lo:104: Request processed in 644us (42479us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390079.342845:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785390079.342863:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785390079.342870:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:11535:x1872116879261056:12345-0@lo:104: 00010000:00010000:0.0:1785390079.342879:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.342914:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1785390079.342919:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+4:11535:x1872116879261056:12345-0@lo:104: Request processed in 50us (42216us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390079.342925:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785390079.342937:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785390079.342944:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:11535:x1872116879261184:12345-0@lo:104: 00010000:00010000:0.0:1785390079.342951:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.343085:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879260928:0@lo:104: 00000100:00100000:2.0:1785390079.343096:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261056:0@lo:104: 00010000:00010000:2.0:1785390079.343106:0:11535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503717000/0x33dffe75ff5ecd3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1befa expref: 12 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.343119:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261312:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390079.343142:0:11535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ecd36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bef3 expref: 11 pid: 5795 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.343150:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535924000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261440:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390079.343206:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785390079.343212:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343219:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4c00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390079.343224:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343233:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390079.343252:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390079.343258:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785390079.343309:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343316:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785390079.343337:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343345:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5ecd60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd67 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343357:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390079.343360:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343366:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5e00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390079.343369:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343376:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390079.343382:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390079.343388:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785390079.343610:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343618:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785390079.343625:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343632:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5e00/0x33dffe75ff5ecd52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.343643:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390079.343645:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390079.343647:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390079.343654:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390079.343667:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879261568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785390079.347761:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1785390079.347787:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1785390079.347793:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1785390079.349830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390079.349941:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785390079.349956:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879261696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390079.351761:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785390079.351774:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:19ebcf8f-53c9-4fee-a69e-b0198873419f+3:11535:x1872116879261184:12345-0@lo:104: Request processed in 8828us (50878us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390079.351784:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785390079.351971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390079.352124:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11535:1872116879261184:0@lo:104: 00010000:00010000:3.0:1785390079.352174:0:11535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.355613:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390079.355627:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.355639:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390079.355643:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.355653:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390079.355681:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390079.355688:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1785390079.355748:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.355755:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785390079.355777:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.355784:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf503717200/0x33dffe75ff5ecd44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ecd4b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.355802:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390079.355804:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390079.355806:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390079.357216:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879261568 00000100:00100000:2.0:1785390079.357226:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879261568 00010000:00010000:2.0:1785390079.357278:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 19 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.357319:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879261696 00000100:00100000:2.0:1785390079.357323:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879261696 00010000:00010000:2.0:1785390079.357336:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 20 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.357358:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1785390079.357379:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e21a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3309:x1872116879261568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785390079.357392:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390079.357397:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 20 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390079.357550:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785390079.357560:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+20:3309:x1872116879261696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390079.357568:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390079.357572:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 20 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.357595:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 20 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.357609:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ecd59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecd52 expref: 20 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.357624:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390079.357688:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879261696:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (5717us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390079.357695:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1785390079.357798:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 18 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.357809:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5ecd67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecd60 expref: 18 pid: 5798 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.357818:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390079.357852:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e21a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3309:x1872116879261568:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (8027us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390079.357858:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785390079.358575:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785390079.358592:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879261824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785390079.358627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390079.359156:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879261824 00000100:00100000:2.0:1785390079.359162:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879261824 00010000:00010000:2.0:1785390079.359179:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 17 pid: 5797 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390079.359205:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785390079.359212:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3308:x1872116879261824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785390079.359220:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390079.359225:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 17 pid: 5797 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359235:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 17 pid: 5797 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359246:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4a00/0x33dffe75ff5ecd4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ecd44 expref: 17 pid: 5797 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359258:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359266:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359281:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359298:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359316:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359323:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359329:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390079.359332:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359341:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359352:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390079.359371:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390079.359547:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3308:x1872116879261824:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390079.359554:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785390079.359588:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879261824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785390079.363309:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879261696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785390079.363326:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879261568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390079.369511:0:11535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.369594:0:11535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390079.369603:0:11535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5ece9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390079.460035:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390080.021926:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879262080:0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.021995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390080.022063:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879262592:0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390080.022159:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785390080.022166:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879262208:0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022190:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390080.022244:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262592 00000100:00100000:3.0:1785390080.022251:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262592 00000100:00100000:3.0:1785390080.022324:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1785390080.022333:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879262592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022385:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879262592:12345-0@lo:400:kworker.0 Request processed in 53us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.022391:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1785390080.022426:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262080 00000100:00100000:3.0:1785390080.022429:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262080 00000100:00100000:3.0:1785390080.022452:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262208 00000100:00100000:3.0:1785390080.022455:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262208 00000100:00100000:3.0:1785390080.022693:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785390080.022702:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879262080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022734:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879262080:12345-0@lo:400:kworker.0 Request processed in 34us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.022740:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1785390080.022752:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1785390080.022758:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879262208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022783:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879262208:12345-0@lo:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.022789:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1785390080.022831:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879262208:0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022842:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879262080:0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.022852:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879262592:0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.022988:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879262336:0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.023018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390080.023047:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1785390080.023053:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879261952:0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.023078:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390080.023098:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879262464:0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.023129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390080.023158:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879261952 00000100:00100000:1.0:1785390080.023162:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879261952 00000100:00100000:1.0:1785390080.023187:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1785390080.023193:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3307:x1872116879261952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.023238:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3307:x1872116879261952:12345-0@lo:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390080.023244:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1785390080.023297:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879261952:0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.023315:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262464 00000100:00100000:1.0:1785390080.023318:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262464 00000100:00100000:1.0:1785390080.023341:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1785390080.023348:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879262464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390080.023380:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879262464:12345-0@lo:400:kworker.0 Request processed in 33us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390080.023386:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1785390080.023424:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879262464:0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.023884:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262336 00000100:00100000:3.0:1785390080.023889:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262336 00000100:00100000:3.0:1785390080.023929:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1785390080.023936:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879262336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390080.023972:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879262336:12345-0@lo:400:kworker.0 Request processed in 36us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.023978:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1785390080.024782:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390080.024789:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785390080.024791:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1785390080.025183:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535833480 x1872116879262336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390080.025197:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879262336:0@lo:400:kworker.0 00010000:00010000:1.0:1785390080.469781:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390080.494958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390080.495379:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763328 00000100:00100000:2.0:1785390080.495390:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763328 00000100:00100000:2.0:1785390080.495448:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 269 00000100:00100000:2.0:1785390080.495459:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:5582:x1872116847763328:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390080.495490:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390080.495511:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ecea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf47 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390080.495564:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ecea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf47 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390080.495577:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ecea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf47 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390080.495893:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121ca00, rc 0) 00000100:00100000:2.0:1785390080.495957:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847763328:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 500us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390080.495965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 269 00000100:00100000:0.0:1785390080.498863:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390080.498945:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763456 00000100:00100000:2.0:1785390080.498953:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763456 00000100:00100000:2.0:1785390080.498999:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 270 00000100:00100000:2.0:1785390080.499009:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847763456:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390080.499327:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847763456:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 319us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390080.499335:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 270 00000100:00100000:1.0:1785390080.509488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390080.509625:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763584 00000100:00100000:2.0:1785390080.509638:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763584 00000100:00100000:2.0:1785390080.509713:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 271 00000100:00100000:2.0:1785390080.509723:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847763584:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785390080.510018:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847763584:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 295us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390080.510033:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 271 00000100:00100000:0.0:1785390080.528204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390080.532562:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763712 00000100:00100000:1.0:1785390080.532583:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763712 00000100:00100000:1.0:1785390080.532669:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:1.0:1785390080.532699:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:9945:x1872116847763712:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785390080.533021:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+12:9945:x1872116847763712:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 324us (4829us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390080.533030:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 272 00000100:00100000:1.0:1785390080.536891:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785390080.536928:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879262720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390080.537014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390080.537114:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262720 00000100:00100000:1.0:1785390080.537122:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262720 00000100:00100000:1.0:1785390080.537170:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785390080.537180:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879262720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390080.537218:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390080.537261:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879262720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390080.537268:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785390080.537576:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879262720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390080.555388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390080.555432:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763840 00000100:00100000:3.0:1785390080.555444:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763840 00000100:00100000:3.0:1785390080.555506:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 273 00000100:00100000:3.0:1785390080.555517:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:9945:x1872116847763840:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1785390080.555844:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+12:9945:x1872116847763840:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 328us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.555854:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 273 00000100:00100000:3.0:1785390080.564816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390080.564876:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847763968 00000100:00100000:3.0:1785390080.564889:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847763968 00000100:00100000:3.0:1785390080.566206:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:3.0:1785390080.566220:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:5582:x1872116847763968:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390080.566244:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390080.566266:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5ecea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf4e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390080.566314:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5ecea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf4e expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390080.566326:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5ecea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf4e expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390080.566354:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5a00, rc 0) 00000100:00100000:3.0:1785390080.566423:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847763968:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 207us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.566431:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 274 00000100:00100000:2.0:1785390080.585396:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390080.588688:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764096 00000100:00100000:1.0:1785390080.588708:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764096 00000100:00100000:1.0:1785390080.588784:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 275 00000100:00100000:1.0:1785390080.588796:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847764096:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390080.589321:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847764096:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 525us (3936us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390080.589330:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 275 00000100:00100000:1.0:1785390080.598363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390080.600315:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764224 00000100:00100000:3.0:1785390080.600332:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764224 00000100:00100000:3.0:1785390080.600408:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:3.0:1785390080.600418:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847764224:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390080.600732:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:5582:x1872116847764224:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 314us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390080.600740:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 276 00000100:00100000:2.0:1785390080.612350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390080.612401:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764352 00000100:00100000:2.0:1785390080.612415:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764352 00000100:00100000:2.0:1785390080.612472:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 277 00000100:00100000:2.0:1785390080.612483:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:9948:x1872116847764352:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390080.612777:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:9948:x1872116847764352:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 294us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390080.612788:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 277 00000100:00100000:0.0:1785390080.634660:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390080.634852:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764480 00000100:00100000:2.0:1785390080.636311:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764480 00000100:00100000:2.0:1785390080.636400:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 278 00000100:00100000:2.0:1785390080.636414:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:9948:x1872116847764480:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390080.640485:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:9948:x1872116847764480:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 4061us (5822us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390080.640503:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 278 00000001:00080000:3.0:1785390080.661260:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000004:00080000:1.0:1785390080.711628:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1785390081.046790:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879262848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390081.046899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.048144:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262848 00000100:00100000:0.0:1785390081.048156:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262848 00000100:00100000:0.0:1785390081.048227:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1785390081.048257:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879262848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390081.048342:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390081.048444:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879262848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390081.048452:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1785390081.048639:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535833800 x1872116879262848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390081.048661:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879262848:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1785390081.303176:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785390081.303186:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf53b946000 from 7 10000000:01000000:0.0:1785390081.303192:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785390081.303262:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390081.303288:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390081.303302:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390081.303337:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879262976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785390081.303433:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.303583:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785390081.314582:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879262976 00000100:00100000:2.0:1785390081.314606:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879262976 00000100:00100000:2.0:1785390081.314729:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1785390081.314746:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:5800:x1872116879262976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390081.314801:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390081.314833:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121d600/0x33dffe75ff5eceb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eceb0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390081.314876:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121d600/0x33dffe75ff5eceb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eceb0 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390081.315304:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121d600/0x33dffe75ff5eceb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eceb0 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390081.315317:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d600, rc 0) 00000100:00100000:2.0:1785390081.315444:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879262976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 683us (11990us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390081.315454:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1785390081.316084:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879262976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390081.316109:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390081.316119:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390081.316205:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390081.316276:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.316322:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803b40 going to sleep for 11 seconds 00000100:00100000:2.0:1785390081.317564:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263104 00000100:00100000:2.0:1785390081.317576:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263104 00000100:00100000:2.0:1785390081.317775:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1785390081.317786:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879263104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390081.319362:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879263104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1554us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390081.319374:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1785390081.319559:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390081.319636:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785390081.319689:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.333123:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785390081.333952:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263232 00000100:00100000:3.0:1785390081.333965:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263232 00000100:00100000:3.0:1785390081.334051:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1785390081.334067:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879263232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390081.334544:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879263232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 483us (14856us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390081.334553:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1785390081.334664:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785390081.334986:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11553:1872116879263360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390081.335041:0:11553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.335065:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088036c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390081.336348:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263360 00000100:00100000:3.0:1785390081.336356:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263360 00000100:00100000:3.0:1785390081.336386:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1785390081.336394:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:11553:x1872116879263360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785390081.336638:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:11553:x1872116879263360:12345-0@lo:502:llog_process_th.0 Request processed in 243us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390081.336652:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1785390081.339423:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11553:1872116879263360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390081.339488:0:11553:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390081.339506:0:11553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390081.339509:0:11553:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1785390081.339518:0:11553:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf53b946000 00000020:00000080:0.0:1785390081.339521:0:11553:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785390081.339682:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11553:1872116879263488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390081.339769:0:11553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.339811:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390081.339910:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263488 00000100:00100000:2.0:1785390081.339918:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263488 00000100:00100000:2.0:1785390081.339974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1785390081.339984:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:11553:x1872116879263488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785390081.340247:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:11553:x1872116879263488:12345-0@lo:502:llog_process_th.0 Request processed in 263us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390081.340264:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1785390081.340370:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11553:1872116879263488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390081.340388:0:11553:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390081.340392:0:11553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390081.340394:0:11553:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785390081.340398:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1785390081.340608:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1785390081.340814:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785390081.340828:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.340909:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390081.340922:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785390081.340925:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5111bb800 from 7 10000000:01000000:1.0:1785390081.340928:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785390081.340966:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.340975:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.340986:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390081.341005:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.341195:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.341225:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1785390081.341242:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263616 00000100:00100000:1.0:1785390081.341247:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263616 00000100:00100000:1.0:1785390081.341285:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1785390081.341294:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:5800:x1872116879263616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390081.341306:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390081.341330:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ecec5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ecebe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.341357:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ecec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ecebe expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.341381:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ecec5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ecebe expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.341393:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4000, rc 0) 00000100:00100000:1.0:1785390081.341491:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879263616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390081.341578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1785390081.341949:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390081.341964:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.341975:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390081.342195:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.342232:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.342249:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1785390081.342263:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263744 00000100:00100000:1.0:1785390081.342278:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263744 00000100:00100000:1.0:1785390081.342302:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1785390081.342309:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879263744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.345234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879263744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2915us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390081.345258:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1785390081.345365:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.346826:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.347181:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.347236:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1785390081.347281:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879263872 00000100:00100000:1.0:1785390081.347290:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879263872 00000100:00100000:1.0:1785390081.347348:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1785390081.347358:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879263872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.348414:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879263872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1053us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390081.348425:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1785390081.349819:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879263872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.351348:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11555:1872116879264000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785390081.352626:0:11555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.353336:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264000 00000100:00100000:1.0:1785390081.353349:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264000 00000100:00100000:1.0:1785390081.354168:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1785390081.354185:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:11555:x1872116879264000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785390081.357166:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:11555:x1872116879264000:12345-0@lo:502:llog_process_th.0 Request processed in 2976us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390081.357183:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1785390081.357289:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390081.357321:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11555:1872116879264000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785390081.357394:0:11555:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785390081.357408:0:11555:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390081.357410:0:11555:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1785390081.357419:0:11555:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf5111bb800 00000020:00000080:1.0:1785390081.357422:0:11555:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1785390081.359116:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11555:1872116879264128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785390081.359199:0:11555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.359246:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390081.359321:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264128 00000100:00100000:3.0:1785390081.359331:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264128 00000100:00100000:3.0:1785390081.359389:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1785390081.359401:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:11555:x1872116879264128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785390081.363766:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:11555:x1872116879264128:12345-0@lo:502:llog_process_th.0 Request processed in 4354us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390081.363785:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1785390081.364005:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11555:1872116879264128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390081.364065:0:11555:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390081.364075:0:11555:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390081.364078:0:11555:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785390081.364083:0:11555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1785390081.364230:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1785390081.364257:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785390081.364282:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.364297:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390081.364310:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1785390081.364313:0:5800:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf509225000 from 7 10000000:01000000:1.0:1785390081.364316:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785390081.364360:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.364369:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.364397:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390081.364424:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879264256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.364481:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.364564:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390081.374460:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264256 00000100:00100000:0.0:1785390081.374481:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264256 00000100:00100000:0.0:1785390081.374573:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1785390081.374585:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:5800:x1872116879264256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390081.374609:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390081.374631:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716400/0x33dffe75ff5eced3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ececc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390081.374666:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716400/0x33dffe75ff5eced3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ececc expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390081.374679:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716400/0x33dffe75ff5eced3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ececc expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390081.374691:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716400, rc 0) 00000100:00100000:0.0:1785390081.374795:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879264256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (10314us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390081.374803:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1785390081.375072:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879264256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390081.375100:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.375114:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390081.375215:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879264384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.375261:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.375350:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390081.380771:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264384 00000100:00100000:0.0:1785390081.380796:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264384 00000100:00100000:0.0:1785390081.384384:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1785390081.384408:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879264384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390081.384831:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879264384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 431us (9568us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390081.384850:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1785390081.390936:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879264384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.391017:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879264512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.391118:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390081.398561:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503b3e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390081.402488:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264512 00000100:00100000:2.0:1785390081.402510:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264512 00000100:00100000:1.0:1785390081.402718:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1785390081.402732:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879264512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390081.403093:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:5800:x1872116879264512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 361us (11973us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390081.403103:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1785390081.403245:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:19ebcf8f-53c9-4fee-a69e-b0198873419f:5800:1872116879264512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785390081.405473:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1785390081.414608:0:11558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11558:1872116879264640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390081.414758:0:11558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.414845:0:11558:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803300 going to sleep for 11 seconds 00000100:00100000:0.0:1785390081.418410:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264640 00000100:00100000:0.0:1785390081.418428:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264640 00000100:00100000:0.0:1785390081.418506:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1785390081.418519:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:11558:x1872116879264640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390081.418893:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:11558:x1872116879264640:12345-0@lo:502:llog_process_th.0 Request processed in 365us (4125us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390081.418901:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1785390081.418985:0:11558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11558:1872116879264640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390081.419026:0:11558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390081.419038:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390081.419041:0:11558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1785390081.419048:0:11558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf509225000 00000020:00000080:0.0:1785390081.419050:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785390081.419147:0:11558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11558:1872116879264768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390081.419197:0:11558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390081.419219:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264768 00000100:00100000:0.0:1785390081.419223:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264768 00000100:00100000:0.0:1785390081.419240:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1785390081.419245:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:11558:x1872116879264768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785390081.422995:0:11558:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803300 going to sleep for 11 seconds 00000100:00100000:1.0:1785390081.447895:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:11558:x1872116879264768:12345-0@lo:502:llog_process_th.0 Request processed in 28630us (28678us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390081.447914:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1785390081.448021:0:11558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:19ebcf8f-53c9-4fee-a69e-b0198873419f:11558:1872116879264768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1785390081.448084:0:11558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785390081.448111:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390081.448114:0:11558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1785390081.448119:0:11558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785390081.448458:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1785390081.448484:0:5800:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785390081.448498:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390081.448511:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390081.502459:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785390082.454417:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1785390082.479507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390082.479797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390082.479910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390082.479952:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764736 00000100:00100000:3.0:1785390082.479954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390082.479965:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764992 00000100:00100000:2.0:1785390082.479970:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764992 00000100:00100000:1.0:1785390082.479970:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764736 00000100:00100000:3.0:1785390082.479995:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764864 00000100:00100000:3.0:1785390082.480005:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764864 00000100:00100000:3.0:1785390082.480078:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:3.0:1785390082.480088:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847764864:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390082.480158:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847764864:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390082.480184:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00080000:3.0:1785390082.480224:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390082.480229:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390082.482008:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847764608 00000100:00100000:0.0:1785390082.482031:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847764608 00000100:00100000:0.0:1785390082.482083:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:0.0:1785390082.482093:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847764608:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390082.482143:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847764608:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 52us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390082.482150:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 294 00000100:00100000:2.0:1785390082.487645:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:2.0:1785390082.487687:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847764736:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390082.487828:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847764736:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 165us (8328us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390082.487840:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:0.0:1785390082.491641:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:0.0:1785390082.491666:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847764992:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390082.491751:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847764992:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 97us (11842us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390082.491759:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00010000:00010000:1.0:1785390082.517956:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390083.542184:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390084.567129:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390085.141878:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390085.144911:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53b9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879265152:0@lo:400:kworker.0 00000100:00100000:2.0:1785390085.145009:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390085.145102:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390085.145108:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53b9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879265024:0@lo:400:kworker.0 00000100:00100000:2.0:1785390085.145133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390085.145171:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265152 00000100:00100000:2.0:1785390085.145181:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265152 00000100:00100000:2.0:1785390085.145269:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265024 00000100:00100000:2.0:1785390085.145273:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265024 00000100:00100000:2.0:1785390085.145311:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1785390085.146808:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1785390085.146826:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879265024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390085.146924:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879265024:12345-0@lo:400:kworker.0 Request processed in 106us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390085.146931:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1785390085.147005:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53b9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879265024:0@lo:400:kworker.0 00000100:00080000:0.0:1785390085.147041:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390085.149095:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879265152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390085.149196:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879265152:12345-0@lo:400:kworker.0 Request processed in 3876us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390085.149204:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1785390085.150512:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53b9ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879265152:0@lo:400:kworker.0 00000100:00100000:1.0:1785390085.154492:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53b9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879265280:0@lo:400:kworker.0 00000100:00100000:1.0:1785390085.154807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390085.154977:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53b9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879264896:0@lo:400:kworker.0 00000100:00100000:1.0:1785390085.155015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390085.158184:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53b9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879265536:0@lo:400:kworker.0 00000100:00100000:3.0:1785390085.158270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390085.158365:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879264896 00000100:00100000:0.0:1785390085.158375:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879264896 00000100:00100000:0.0:1785390085.158450:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1785390085.158461:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879264896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390085.158541:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879264896:12345-0@lo:400:kworker.0 Request processed in 66us (3508us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390085.158567:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1785390085.158651:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53b9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879265408:0@lo:400:kworker.0 00000100:00100000:0.0:1785390085.158683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390085.158726:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265408 00000100:00100000:0.0:1785390085.158730:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265408 00000100:00080000:0.0:1785390085.158754:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390085.158781:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1785390085.158788:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879265408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390085.158823:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879265408:12345-0@lo:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390085.158829:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1785390085.158866:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53b9cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879265408:0@lo:400:kworker.0 00000100:00100000:1.0:1785390085.161491:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53b9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879264896:0@lo:400:kworker.0 00000100:00100000:2.0:1785390085.178719:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265280 00000100:00100000:2.0:1785390085.178739:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265280 00000100:00100000:2.0:1785390085.178862:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265536 00000100:00100000:2.0:1785390085.178865:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265536 00000100:00100000:2.0:1785390085.178901:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785390085.178914:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879265280:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785390085.179094:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390085.179099:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390085.179175:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1785390085.179186:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879265536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390085.179326:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879265536:12345-0@lo:400:kworker.0 Request processed in 135us (21049us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390085.179335:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1785390085.179559:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1785390085.179567:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf51f10dc00, transno 4294967300 00000100:00100000:0.0:1785390085.179597:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53b9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879265536:0@lo:400:kworker.0 00000100:00100000:2.0:1785390085.179840:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879265280:12345-0@lo:400:kworker.0 Request processed in 929us (25032us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390085.179848:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1785390085.180586:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53b9cfb80 x1872116879265280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390085.180600:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53b9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879265280:0@lo:400:kworker.0 00010000:00010000:1.0:1785390085.590730:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390085.653751:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785390085.653786:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879265664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390085.653894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390085.657547:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265664 00000100:00100000:0.0:1785390085.657562:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265664 00000100:00100000:0.0:1785390085.657606:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785390085.657616:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51105c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879265664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785390085.657652:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390085.657739:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51105c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879265664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390085.657746:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1785390085.661410:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879265664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390086.167140:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390086.167167:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879265792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390086.167241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390086.167343:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265792 00000100:00100000:3.0:1785390086.167351:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265792 00000100:00100000:3.0:1785390086.167405:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785390086.167415:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879265792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390086.167452:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390086.167516:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879265792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390086.167545:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1785390086.167621:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535832a00 x1872116879265792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390086.167638:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879265792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390086.613797:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390087.598485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390087.598560:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390087.598595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390087.598624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390087.598651:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765376 00000100:00100000:3.0:1785390087.598660:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765376 00000100:00100000:2.0:1785390087.598666:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765248 00000100:00100000:2.0:1785390087.598673:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765248 00000100:00100000:2.0:1785390087.598718:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765504 00000100:00100000:3.0:1785390087.598722:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1785390087.598723:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765504 00000100:00100000:3.0:1785390087.598733:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847765376:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390087.598753:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:2.0:1785390087.598762:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847765248:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390087.598833:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847765248:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 72us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390087.598840:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:2.0:1785390087.598864:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:2.0:1785390087.598870:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847765504:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390087.598895:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847765504:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390087.598900:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:3.0:1785390087.598943:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847765376:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 210us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390087.598952:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:1.0:1785390087.599074:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765120 00000100:00100000:1.0:1785390087.599079:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765120 00000100:00100000:1.0:1785390087.599117:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00100000:1.0:1785390087.599136:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847765120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390087.599180:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847765120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 55us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390087.599187:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 296 00000100:00080000:0.0:1785390087.600890:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390087.600899:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785390087.637773:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390088.661780:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390089.685899:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390090.266929:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879266304:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.266999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390090.267052:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1785390090.267059:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879265920:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390090.267108:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879266432:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390090.267158:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879266048:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390090.267211:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879266560:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390090.267251:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785390090.267256:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879266176:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390090.267307:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266304 00000100:00100000:0.0:1785390090.267314:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266304 00000100:00100000:0.0:1785390090.267359:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266560 00000100:00100000:0.0:1785390090.267362:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266560 00000100:00100000:0.0:1785390090.267385:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1785390090.267394:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879266304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267466:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879266304:12345-0@lo:400:kworker.0 Request processed in 72us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390090.267474:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1785390090.267490:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1785390090.267497:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879266560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267545:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879266560:12345-0@lo:400:kworker.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390090.267550:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1785390090.267569:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879265920 00000100:00100000:0.0:1785390090.267573:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879265920 00000100:00100000:0.0:1785390090.267596:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1785390090.267602:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879265920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267631:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3307:x1872116879265920:12345-0@lo:400:kworker.0 Request processed in 29us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390090.267637:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1785390090.267662:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266432 00000100:00100000:0.0:1785390090.267666:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266432 00000100:00100000:0.0:1785390090.267690:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266048 00000100:00100000:0.0:1785390090.267693:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266048 00000100:00100000:0.0:1785390090.267704:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266176 00000100:00100000:0.0:1785390090.267707:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266176 00000100:00100000:0.0:1785390090.267720:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1785390090.267726:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879266432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.267969:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879266432:12345-0@lo:400:kworker.0 Request processed in 241us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390090.267976:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1785390090.267989:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1785390090.268002:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879266048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.268032:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879266048:12345-0@lo:400:kworker.0 Request processed in 30us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390090.268038:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1785390090.268051:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1785390090.268057:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879266176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.268084:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879266176:12345-0@lo:400:kworker.0 Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390090.268090:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1785390090.268112:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390090.268116:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390090.268118:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390090.268143:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:19ebcf8f-53c9-4fee-a69e-b0198873419f:3307:1872116879265920:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.268157:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879266432:0@lo:400:kworker.0 00010000:00080000:0.0:1785390090.268169:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535832300 x1872116879266304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390090.268180:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879266304:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.268223:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879266176:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.268233:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879266048:0@lo:400:kworker.0 00000100:00100000:0.0:1785390090.268242:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879266560:0@lo:400:kworker.0 00010000:00010000:1.0:1785390090.709683:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390090.777217:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785390090.777241:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879266688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390090.777381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390090.777550:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266688 00000100:00100000:1.0:1785390090.777558:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266688 00000100:00100000:1.0:1785390090.777605:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785390090.777614:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879266688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390090.777646:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390090.777703:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879266688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390090.777710:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1785390090.777920:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879266688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390091.286648:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879266816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390091.286726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390091.286868:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266816 00000100:00100000:1.0:1785390091.286877:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266816 00000100:00100000:1.0:1785390091.286928:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1785390091.286938:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879266816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390091.286973:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390091.287028:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879266816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390091.287036:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1785390091.287170:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535831880 x1872116879266816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390091.287201:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879266816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390091.733711:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785390092.698449:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1785390092.740698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390092.740749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390092.740882:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765760 00000100:00100000:1.0:1785390092.740891:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765760 00000100:00100000:1.0:1785390092.741038:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:1.0:1785390092.741048:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847765760:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390092.741197:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847765760:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 150us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390092.741204:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00080000:0.0:1785390092.741815:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390092.745937:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765632 00000100:00100000:2.0:1785390092.745951:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765632 00000100:00100000:2.0:1785390092.746021:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:2.0:1785390092.746032:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847765632:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390092.746112:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847765632:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 82us (5424us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390092.746120:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 298 00000100:00100000:3.0:1785390092.746960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390092.747034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390092.747303:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766016 00000100:00100000:1.0:1785390092.747320:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766016 00000100:00100000:1.0:1785390092.747380:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:1.0:1785390092.747388:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847766016:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390092.747443:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847766016:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 56us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390092.747450:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00080000:0.0:1785390092.748895:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390092.749340:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847765888 00000100:00100000:2.0:1785390092.749348:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847765888 00000100:00100000:2.0:1785390092.749409:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1785390092.749417:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2356:x1872116847765888:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:2.0:1785390092.749450:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ece0f 00000100:00080000:2.0:1785390092.749458:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785390092.749495:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1785390092.749749:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+2:2356:x1872116847765888:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 332us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390092.749756:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00080000:0.0:1785390092.749946:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785390092.749990:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390092.757752:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390093.788816:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390094.806707:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390095.382744:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879267072:0@lo:400:kworker.0 00000100:00100000:1.0:1785390095.382810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390095.382913:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879266944:0@lo:400:kworker.0 00000100:00100000:3.0:1785390095.382949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390095.384592:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879267200:0@lo:400:kworker.0 00000100:00100000:3.0:1785390095.384632:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390095.384677:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267072 00000100:00100000:3.0:1785390095.384685:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267072 00000100:00100000:3.0:1785390095.384730:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267200 00000100:00100000:3.0:1785390095.384732:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267200 00000100:00100000:3.0:1785390095.384758:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1785390095.384766:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879267072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390095.384857:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879266944 00000100:00100000:0.0:1785390095.384862:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879266944 00000100:00100000:0.0:1785390095.384891:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1785390095.384897:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879266944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390095.384938:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879266944:12345-0@lo:400:kworker.0 Request processed in 41us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390095.384944:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:0.0:1785390095.384971:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390095.384998:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879266944:0@lo:400:kworker.0 00000100:00100000:0.0:1785390095.385040:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1785390095.385047:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879267200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390095.385076:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879267200:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390095.385082:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1785390095.388628:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879267200:0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.392037:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879267456:0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.392102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390095.392134:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390095.392168:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879267328:0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.392194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390095.392224:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267328 00000100:00100000:2.0:1785390095.392230:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267328 00000100:00100000:2.0:1785390095.392290:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1785390095.392299:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879267328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.392356:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879267328:12345-0@lo:400:kworker.0 Request processed in 59us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390095.392362:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1785390095.392384:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785390095.393576:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e155880 x1872116879267328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390095.393590:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879267328:0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.393617:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267456 00000100:00100000:2.0:1785390095.393621:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267456 00000100:00100000:2.0:1785390095.393664:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1785390095.393671:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879267456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.393733:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879267456:12345-0@lo:400:kworker.0 Request processed in 62us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390095.393740:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1785390095.393754:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390095.393770:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879267456:0@lo:400:kworker.0 00000100:00100000:0.0:1785390095.393909:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785390095.393921:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879267584:0@lo:400:kworker.0 00000100:00100000:0.0:1785390095.393950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390095.394082:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879267072:12345-0@lo:400:kworker.0 Request processed in 9314us (11269us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390095.394091:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1785390095.397515:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267584 00000100:00100000:2.0:1785390095.397755:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267584 00000100:00100000:2.0:1785390095.397822:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1785390095.397833:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879267584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390095.397967:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879267584:12345-0@lo:400:kworker.0 Request processed in 136us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390095.397974:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1785390095.398113:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879267584:0@lo:400:kworker.0 00000100:00080000:3.0:1785390095.398596:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390095.402550:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879267072:0@lo:400:kworker.0 00010000:00010000:1.0:1785390095.831226:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390095.893928:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879267712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390095.894001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390095.894121:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267712 00000100:00100000:1.0:1785390095.894129:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267712 00000100:00100000:1.0:1785390095.894203:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785390095.894212:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879267712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390095.894244:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390095.894301:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879267712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390095.894309:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785390095.894349:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879267712:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1785390096.063204:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:1.0:1785390096.063215:0:7506:0:(genops.c:906:class_export_put()) final put ffff8cf51f0e4000/db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:0.0:1785390096.063720:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf51f0e4000/db9e37b8-1bb4-4113-a95f-cdba66461e5f for lustre-OST0001 00000020:00000080:0.0:1785390096.063772:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf51f0e2800 for lustre-OST0001 00000100:00100000:1.0:1785390096.406697:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390096.406733:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879267840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390096.406799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390096.407541:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267840 00000100:00100000:0.0:1785390096.407550:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267840 00000100:00100000:0.0:1785390096.407607:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1785390096.407616:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879267840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390096.407661:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390096.407716:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879267840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390096.407723:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1785390096.407859:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535832a00 x1872116879267840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390096.407877:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879267840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390096.854034:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390097.843051:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390097.843102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390097.843134:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766272 00000100:00100000:0.0:1785390097.843143:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766272 00000100:00100000:0.0:1785390097.843218:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00080000:3.0:1785390097.843225:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390097.843228:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847766272:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390097.843309:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847766272:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390097.843317:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:1.0:1785390097.843425:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766144 00000100:00100000:1.0:1785390097.843430:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766144 00000100:00100000:1.0:1785390097.843464:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:1.0:1785390097.843471:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847766144:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390097.843514:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847766144:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390097.843521:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 300 00000100:00100000:3.0:1785390097.844299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390097.844416:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766400 00000100:00100000:2.0:1785390097.844422:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766400 00000100:00100000:2.0:1785390097.844472:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:2.0:1785390097.844480:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847766400:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390097.844544:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847766400:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390097.844551:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00080000:3.0:1785390097.844700:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785390097.877850:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390098.902721:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390099.927401:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390100.505428:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879267968:0@lo:400:kworker.0 00000100:00100000:2.0:1785390100.505429:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879268096:0@lo:400:kworker.0 00000100:00100000:0.0:1785390100.505487:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879268352:0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.514354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390100.514409:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879268480:0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.514440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390100.514674:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879268224:0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.514700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390100.514732:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268480 00000100:00100000:3.0:1785390100.514739:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268480 00000100:00100000:3.0:1785390100.514780:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268224 00000100:00100000:3.0:1785390100.514782:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268224 00000100:00100000:3.0:1785390100.514801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1785390100.514808:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879268480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.514859:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879268480:12345-0@lo:400:kworker.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390100.514866:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1785390100.514880:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1785390100.514885:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879268224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.514909:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879268224:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390100.514914:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1785390100.514927:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390100.516187:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879268224:0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.516266:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879268480:0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.516660:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879267968 00000100:00100000:3.0:1785390100.516666:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879267968 00000100:00100000:3.0:1785390100.516704:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1785390100.516711:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879267968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390100.516761:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879267968:12345-0@lo:400:kworker.0 Request processed in 51us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390100.516769:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1785390100.516806:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879267968:0@lo:400:kworker.0 00000100:00100000:0.0:1785390100.526214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390100.526378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390100.526415:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879268608:0@lo:400:kworker.0 00000100:00100000:2.0:1785390100.526445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390100.526474:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268352 00000100:00100000:2.0:1785390100.526482:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268352 00000100:00100000:2.0:1785390100.526559:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268608 00000100:00100000:2.0:1785390100.526562:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268608 00000100:00100000:2.0:1785390100.526580:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785390100.526588:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879268352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390100.526634:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879268352:12345-0@lo:400:kworker.0 Request processed in 47us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390100.526640:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785390100.526655:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1785390100.526659:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879268608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390100.526679:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879268608:12345-0@lo:400:kworker.0 Request processed in 20us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390100.526687:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1785390100.526721:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879268608:0@lo:400:kworker.0 00010000:00080000:0.0:1785390100.526872:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf50e154e00 x1872116879268352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390100.526893:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879268352:0@lo:400:kworker.0 00000100:00100000:0.0:1785390100.526908:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268096 00000100:00100000:0.0:1785390100.526910:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268096 00000100:00100000:0.0:1785390100.526931:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1785390100.526936:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879268096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390100.526970:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879268096:12345-0@lo:400:kworker.0 Request processed in 34us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390100.526985:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1785390100.527012:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879268096:0@lo:400:kworker.0 00000100:00080000:3.0:1785390100.527040:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390100.527044:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1785390100.961520:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390101.021634:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785390101.021655:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879268736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390101.021715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390101.021766:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268736 00000100:00100000:1.0:1785390101.021773:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268736 00000100:00100000:1.0:1785390101.021828:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1785390101.021835:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879268736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390101.021867:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390101.021910:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879268736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390101.021925:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1785390101.021980:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879268736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390101.526119:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390101.526141:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879268864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390101.526202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390101.526294:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268864 00000100:00100000:0.0:1785390101.526301:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268864 00000100:00100000:1.0:1785390101.526417:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1785390101.526427:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879268864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390101.526459:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390101.526514:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879268864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390101.526521:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1785390101.526560:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535832680 x1872116879268864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390101.526578:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879268864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390101.974713:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785390102.935132:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1785390102.968018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390102.968046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390102.968064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390102.968098:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766528 00000100:00100000:0.0:1785390102.968107:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766528 00000100:00100000:0.0:1785390102.968144:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:0.0:1785390102.968152:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847766528:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390102.968210:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847766528:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390102.968231:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 302 00000100:00100000:0.0:1785390102.968287:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766784 00000100:00100000:0.0:1785390102.968290:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766784 00000100:00100000:0.0:1785390102.968316:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766656 00000100:00100000:0.0:1785390102.968318:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766656 00000100:00100000:0.0:1785390102.968335:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:0.0:1785390102.968340:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847766784:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390102.968366:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847766784:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390102.968388:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:0.0:1785390102.968400:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:0.0:1785390102.968406:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847766656:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390102.968433:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847766656:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390102.968439:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00080000:0.0:1785390102.968562:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785390103.002378:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390104.021949:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390105.049504:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785390105.464508:0:11719:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:41:43 (1785390103) 00000100:00100000:2.0:1785390105.622986:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879269248:0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623063:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390105.623112:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1785390105.623118:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879269120:0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390105.623152:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879269632:0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390105.623197:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269248 00000100:00100000:2.0:1785390105.623208:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269248 00000100:00100000:2.0:1785390105.623267:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269120 00000100:00100000:2.0:1785390105.623278:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269120 00000100:00100000:2.0:1785390105.623302:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1785390105.623309:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879269248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623354:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879269248:12345-0@lo:400:kworker.0 Request processed in 45us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390105.623361:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1785390105.623376:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1785390105.623382:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879269120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623407:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879269120:12345-0@lo:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390105.623414:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1785390105.623434:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269632 00000100:00100000:2.0:1785390105.623438:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269632 00000100:00100000:2.0:1785390105.623461:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785390105.623467:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879269632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623495:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879269632:12345-0@lo:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390105.623500:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1785390105.623513:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390105.623517:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390105.623565:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879269120:0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623575:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879269632:0@lo:400:kworker.0 00000100:00100000:2.0:1785390105.623582:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879269248:0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.623830:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879268992:0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.623864:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390105.623888:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879269504:0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.623909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390105.623925:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390105.623930:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879269376:0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.623950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390105.623981:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879268992 00000100:00100000:1.0:1785390105.623985:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879268992 00000100:00100000:1.0:1785390105.624012:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1785390105.624018:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879268992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.624065:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879268992:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390105.624079:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1785390105.624105:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269504 00000100:00100000:1.0:1785390105.624108:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269504 00000100:00100000:1.0:1785390105.624139:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1785390105.624145:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879269504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.624172:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879269504:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390105.624178:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1785390105.624193:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269376 00000100:00100000:1.0:1785390105.624196:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269376 00000100:00100000:1.0:1785390105.624369:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1785390105.624377:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879269376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.624408:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879269376:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390105.624414:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1785390105.624431:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785390105.624434:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1785390105.624456:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53a354e00 x1872116879269376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390105.624467:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879269376:0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.624474:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879268992:0@lo:400:kworker.0 00000100:00100000:1.0:1785390105.624483:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879269504:0@lo:400:kworker.0 00010000:00010000:1.0:1785390106.070107:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390106.137603:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879269760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390106.137668:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390106.138235:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269760 00000100:00100000:1.0:1785390106.138243:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269760 00000100:00100000:1.0:1785390106.138299:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785390106.138308:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879269760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390106.138340:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390106.140261:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879269760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1947us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390106.140272:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1785390106.143614:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879269760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390106.648351:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879269888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390106.648416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390106.648553:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879269888 00000100:00100000:3.0:1785390106.648561:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879269888 00000100:00100000:3.0:1785390106.648609:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1785390106.648617:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879269888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390106.648650:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390106.648692:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879269888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390106.648698:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1785390106.648746:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535833100 x1872116879269888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390106.648762:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879269888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390107.094624:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390108.085510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390108.085657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390108.085721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390108.085820:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767168 00000100:00100000:2.0:1785390108.085834:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767168 00000100:00100000:2.0:1785390108.085915:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767040 00000100:00100000:2.0:1785390108.085919:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767040 00000100:00100000:2.0:1785390108.085946:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:2.0:1785390108.085957:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847767168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390108.086070:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847767168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 114us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390108.086078:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:2.0:1785390108.086099:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:2.0:1785390108.086106:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847767040:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390108.086132:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847767040:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390108.086138:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00080000:1.0:1785390108.086782:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390108.093703:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847766912 00000100:00100000:0.0:1785390108.093723:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847766912 00000100:00100000:0.0:1785390108.093821:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 304 00000100:00100000:0.0:1785390108.093835:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847766912:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390108.093954:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847766912:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 121us (8734us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390108.093963:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 304 00010000:00010000:1.0:1785390108.117851:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390108.707579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390108.707766:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767296 00000100:00100000:0.0:1785390108.707781:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767296 00000100:00100000:0.0:1785390108.707855:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:0.0:1785390108.707868:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:10218:x1872116847767296:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390108.707897:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390108.707929:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5eceda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf55 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.708010:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecee1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.708055:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.708071:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390108.708338:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785390108.708343:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390108.708452:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecee1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.708485:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5eceda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf55 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.708505:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecee1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf55 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.708515:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390108.708518:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390108.708565:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717000, rc 0) 00000100:00100000:0.0:1785390108.708645:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:10218:x1872116847767296:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 780us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390108.708654:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:3.0:1785390108.712665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390108.712808:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767424 00000100:00100000:2.0:1785390108.712818:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767424 00000100:00100000:2.0:1785390108.712870:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1785390108.712881:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:10219:x1872116847767424:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390108.712901:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390108.712932:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ecee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.712989:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713003:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713038:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713054:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713063:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713069:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713678:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ecefd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713688:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ecefd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.713695:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ecefd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390108.714405:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1785390108.714410:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390108.715059:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ecefd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.715074:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.715082:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.715101:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.715108:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390108.715112:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716000:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716030:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390108.716033:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390108.716039:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716046:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5eceef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716060:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716068:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716073:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716079:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390108.716082:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716100:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716109:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cf50629b100) 00010000:00010000:2.0:1785390108.716112:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390108.716114:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716302:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ecef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716348:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ecee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf5c expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716362:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ecefd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf5c expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390108.716370:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf50629bc00) 00010000:00010000:2.0:1785390108.716373:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390108.716375:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d800, rc 0) 00000100:00100000:2.0:1785390108.716520:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:10219:x1872116847767424:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 3639us (3861us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390108.716541:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1785390108.742349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390108.742495:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767680 00000100:00100000:0.0:1785390108.742511:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767680 00000100:00100000:0.0:1785390108.742638:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1785390108.742649:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:10219:x1872116847767680:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390108.742676:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390108.742716:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecf04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf63 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.742804:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.742820:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.742832:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.742846:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.742852:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.742859:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.743881:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716c00/0x33dffe75ff5ecf19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.743894:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716c00/0x33dffe75ff5ecf19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.743903:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716c00/0x33dffe75ff5ecf19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390108.743915:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1785390108.744177:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744197:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744205:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744213:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390108.744229:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744238:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744253:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf50629bc00) 00010000:00010000:0.0:1785390108.744256:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390108.744262:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744269:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecf0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744283:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744290:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744306:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744312:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390108.744321:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744328:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744335:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cf50896c200) 00010000:00010000:0.0:1785390108.744338:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390108.744341:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.744346:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ecf12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.749503:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecf04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf63 expref: 10 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.749560:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716c00/0x33dffe75ff5ecf19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf63 expref: 9 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390108.749572:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:0.0:1785390108.749575:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390108.749579:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716c00, rc 0) 00000100:00100000:0.0:1785390108.749848:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10219:x1872116847767680:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 7198us (7505us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1785390108.749859:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:1.0:1785390108.756579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390108.756733:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767808 00000100:00100000:2.0:1785390108.756746:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767808 00000100:00100000:2.0:1785390108.756829:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1785390108.756840:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10219:x1872116847767808:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1785390108.756989:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10219:x1872116847767808:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 146us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390108.756996:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000040:00080000:2.0:1785390109.079829:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785390109.145127:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390110.166794:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390110.744418:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879270016:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390110.744548:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879270528:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390110.744594:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785390110.744599:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879270400:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390110.744640:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879270272:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744657:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390110.744671:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785390110.744687:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879270144:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744706:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390110.744720:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879270656:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390110.744759:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270016 00000100:00100000:0.0:1785390110.744775:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270016 00000100:00100000:0.0:1785390110.744814:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1785390110.744822:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879270016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744864:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879270016:12345-0@lo:400:kworker.0 Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390110.744871:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1785390110.744896:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270528 00000100:00100000:0.0:1785390110.744900:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270528 00000100:00100000:0.0:1785390110.744930:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270272 00000100:00100000:0.0:1785390110.744934:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270272 00000100:00100000:0.0:1785390110.744945:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270144 00000100:00100000:0.0:1785390110.744947:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270144 00000100:00100000:0.0:1785390110.744957:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1785390110.744962:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879270528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.744999:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879270528:12345-0@lo:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390110.745016:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1785390110.745028:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1785390110.745033:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879270272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745060:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879270272:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390110.745067:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1785390110.745075:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1785390110.745080:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879270144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745102:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879270144:12345-0@lo:400:kworker.0 Request processed in 22us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390110.745107:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1785390110.745121:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270400 00000100:00100000:0.0:1785390110.745124:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270400 00000100:00100000:0.0:1785390110.745144:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270656 00000100:00100000:0.0:1785390110.745146:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270656 00000100:00100000:0.0:1785390110.745161:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785390110.745166:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879270400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745190:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879270400:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390110.745359:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785390110.745373:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785390110.745379:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879270656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745405:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879270656:12345-0@lo:400:kworker.0 Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390110.745418:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1785390110.745445:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390110.745448:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390110.745450:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390110.745480:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879270144:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745489:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879270656:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745496:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879270272:0@lo:400:kworker.0 00010000:00080000:0.0:1785390110.745541:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf535831880 x1872116879270400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1785390126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390110.745552:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879270400:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745560:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879270016:0@lo:400:kworker.0 00000100:00100000:0.0:1785390110.745568:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879270528:0@lo:400:kworker.0 00010000:00010000:0.0:1785390111.193450:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390111.260409:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879270784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390111.260476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390111.260561:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879270784 00000100:00100000:0.0:1785390111.260568:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879270784 00000100:00100000:0.0:1785390111.260613:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785390111.260623:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879270784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785390111.260657:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390111.260701:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879270784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390111.260708:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1785390111.260776:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879270784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390111.360161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390111.363673:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847767936 00000100:00100000:3.0:1785390111.363687:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847767936 00000100:00100000:3.0:1785390111.363749:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1785390111.363771:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10261:x1872116847767936:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390111.363791:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390111.363812:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ecf27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf6a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.363882:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.363908:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.363920:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.363936:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.363952:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.363959:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364182:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364191:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364198:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364204:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390111.364209:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364226:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364239:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390111.364242:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390111.364247:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364253:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecf2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364263:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364270:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364276:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364280:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390111.364283:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364289:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364296:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cf520a1d800) 00010000:00010000:3.0:1785390111.364298:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390111.364301:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364318:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364351:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ecf27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf6a expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364362:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390111.364364:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390111.364368:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ecf27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf6a expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.364377:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785390111.364445:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10261:x1872116847767936:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 687us (4291us total) trans 0 rc 301/301 00000100:00100000:3.0:1785390111.364452:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00080000:0.0:1785390111.365613:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1785390111.392400:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1785390111.392874:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.394069:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847768192 00000100:00100000:0.0:1785390111.394080:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847768192 00000100:00100000:0.0:1785390111.394225:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1785390111.394236:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:10261:x1872116847768192:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:0.0:1785390111.394293:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390111.394318:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecee1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf55 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.394336:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390111.394345:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390111.394610:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.394623:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.394633:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.394646:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.394653:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.394660:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390111.395697:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1785390111.395714:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.395723:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.395730:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.395736:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390111.395740:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.395748:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.395758:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50896cc00) 00010000:00010000:0.0:1785390111.395762:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390111.395765:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.395772:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390111.395785:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092d59f43 reply state 0000000071369ce7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390111.395793:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785390111.395895:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10261:x1872116847768192:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 1659us (3023us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1785390111.395903:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00010000:00010000:1.0:1785390111.398054:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.398070:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.398078:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.398084:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390111.398088:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.398105:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.398117:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cf50896c200) 00010000:00010000:1.0:1785390111.398120:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390111.398124:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.398130:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ecf43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390111.543705:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390111.543748:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847768320 00000100:00100000:3.0:1785390111.543757:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847768320 00000100:00100000:3.0:1785390111.543848:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1785390111.543858:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:10269:x1872116847768320:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:3.0:1785390111.543881:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390111.543903:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ecf4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf71 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.543966:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.543986:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.544010:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390111.544065:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785390111.544069:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390111.544106:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.544131:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ecf4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf71 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.544148:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf71 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390111.544157:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390111.544160:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390111.544163:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4c00, rc 0) 00000100:00100000:3.0:1785390111.544216:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10269:x1872116847768320:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 360us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390111.544224:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1785390111.651955:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.652086:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847768448 00000100:00100000:0.0:1785390111.652117:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847768448 00000100:00100000:0.0:1785390111.652191:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1785390111.652200:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:10275:x1872116847768448:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390111.652219:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390111.652241:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf78 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652305:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652320:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652332:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652347:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652354:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652360:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652467:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ecf6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652474:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ecf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652481:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ecf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390111.652519:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1785390111.652562:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390111.652604:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ecf6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652616:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652622:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652629:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652635:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390111.652639:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652646:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652658:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390111.652661:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390111.652666:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652672:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ecf5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652684:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652701:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652707:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652711:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390111.652714:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652720:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652728:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cf50896cc00) 00010000:00010000:0.0:1785390111.652730:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390111.652733:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652738:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ecf66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652766:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ecf58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf78 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652779:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ecf6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf78 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.652786:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390111.652788:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1785390111.652797:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717600, rc 0) 00000100:00100000:0.0:1785390111.652862:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:10275:x1872116847768448:12345-192.168.202.54@tcp:101:bash.0 Request processed in 662us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390111.652871:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1785390111.656091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.658639:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847768704 00000100:00100000:0.0:1785390111.658653:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847768704 00000100:00100000:0.0:1785390111.658721:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:0.0:1785390111.658730:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:10275:x1872116847768704:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390111.658750:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390111.658769:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ecf74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.658923:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.658938:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.658950:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659016:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659023:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659028:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785390111.659601:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1785390111.659776:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659792:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659800:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659834:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659841:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659848:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659854:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390111.659859:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659866:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659878:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390111.659881:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390111.659885:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659892:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ecf7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390111.659902:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035dd2c5c reply state 00000000ba4bf4b7 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390111.659916:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785390111.659942:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ecf74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659956:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.659964:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:1.0:1785390111.659966:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390111.659968:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390111.660048:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10275:x1872116847768704:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1318us (3966us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1785390111.660057:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:0.0:1785390111.662054:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.662068:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.662075:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.662081:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390111.662084:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.662091:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.662103:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf510c5a400) 00010000:00010000:0.0:1785390111.662105:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390111.662119:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.662125:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ecf82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390111.665069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.665159:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847768832 00000100:00100000:0.0:1785390111.665169:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847768832 00000100:00100000:0.0:1785390111.665228:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1785390111.665236:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1872116847768832:12345-192.168.202.54@tcp:8:bash.0 00010000:00080000:0.0:1785390111.665270:0:6597:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:0.0:1785390111.665298:0:6597:0:(genops.c:1406:class_connect()) connect: client db9e37b8-1bb4-4113-a95f-cdba66461e5f, cookie 0x33dffe75ff5ecf97 00002000:00100000:0.0:1785390111.665311:0:6597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli db9e37b8-1bb4-4113-a95f-cdba66461e5f/ffff8cf5034c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785390111.665336:0:6597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1785390111.665612:0:6597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1785390111.665653:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf5034c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390111.665708:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2356:x1872116847768832:12345-192.168.202.54@tcp:8:bash.0 Request processed in 471us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390111.665716:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1785390111.670505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.670658:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847768960 00000100:00100000:0.0:1785390111.670667:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847768960 00000100:00100000:0.0:1785390111.670731:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1785390111.670740:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:0:x1872116847768960:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390111.670758:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390111.670779:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf86 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390111.670815:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785390111.670846:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=420s v=(0 0) 00010000:00010000:0.0:1785390111.670851:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390111.670861:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.670881:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.670894:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717c00, rc 0) 00000100:00100000:0.0:1785390111.670952:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:0:x1872116847768960:12345-192.168.202.54@tcp:101:bash.0 Request processed in 214us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390111.670959:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00080000:2.0:1785390111.671493:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390111.673967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.674036:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847769088 00000100:00100000:0.0:1785390111.674045:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847769088 00000100:00100000:0.0:1785390111.674092:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1785390111.674100:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:10275:x1872116847769088:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390111.674114:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390111.674127:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf8d expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.674154:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.674164:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390111.674168:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390111.674173:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.674212:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.674226:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390111.674240:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879270912:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390111.674373:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390111.683149:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879270912:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390111.683185:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.683219:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717e00, rc 0) 00000100:00100000:0.0:1785390111.683277:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:10275:x1872116847769088:12345-192.168.202.54@tcp:101:bash.0 Request processed in 9177us (9316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390111.683286:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1785390111.686497:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390111.686611:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847769216 00000100:00100000:2.0:1785390111.686629:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847769216 00010000:00010000:2.0:1785390111.686664:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390111.686705:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1785390111.686714:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847769216:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390111.686727:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390111.686748:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.686760:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.686802:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008ed10df/0x33dffe75ff5ecf9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf86 expref: 8 pid: 6599 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.686818:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390111.686822:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390111.686830:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.686854:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.686889:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390111.686905:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879271040:192.168.202.54@tcp:105: 00000100:00100000:2.0:1785390111.686979:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390111.689680:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e155180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879271040:192.168.202.54@tcp:105: 00010000:00010000:2.0:1785390111.689703:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390111.689863:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847769216:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3147us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390111.689873:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1785390111.693118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390111.693412:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847769472 00000100:00100000:3.0:1785390111.693431:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847769472 00000100:00100000:3.0:1785390111.693573:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1785390111.693584:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:10275:x1872116847769472:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1785390111.694744:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10275:x1872116847769472:12345-192.168.202.54@tcp:35:bash.0 Request processed in 1160us (1633us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1785390111.694753:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:3.0:1785390111.766170:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879271168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390111.766244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390111.766389:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879271168 00000100:00100000:0.0:1785390111.766397:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879271168 00000100:00100000:0.0:1785390111.766457:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1785390111.766467:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879271168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390111.766488:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390111.766549:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879271168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390111.766555:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1785390111.766732:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879271168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390111.826882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.827911:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847769728 00000100:00100000:0.0:1785390111.827922:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847769728 00000100:00100000:0.0:1785390111.827984:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1785390111.828023:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10285:x1872116847769728:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390111.828048:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390111.828071:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecfac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf94 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390111.828179:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1785390111.828299:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecfac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf94 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.828313:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390111.828316:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785390111.828321:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecfac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf94 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.828335:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717200, rc 0) 00000100:00100000:0.0:1785390111.828403:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10285:x1872116847769728:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 410us (1529us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1785390111.828410:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1785390111.831506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390111.831622:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847769984 00000100:00100000:1.0:1785390111.831632:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847769984 00000100:00100000:1.0:1785390111.831687:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1785390111.831699:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10285:x1872116847769984:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390111.831946:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:10285:x1872116847769984:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 249us (447us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1785390111.831954:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:3.0:1785390111.975064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390111.975160:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847770112 00000100:00100000:2.0:1785390111.975170:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847770112 00000100:00100000:2.0:1785390111.975235:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:2.0:1785390111.975245:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:10291:x1872116847770112:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390111.975268:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390111.975289:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ecfba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bf9b expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.975356:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ecfc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.975381:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ecfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.975392:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ecfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390111.975447:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1785390111.975451:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390111.975475:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ecfc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.975499:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ecfba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf9b expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.975517:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ecfc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf9b expref: 16 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.975566:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390111.975569:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390111.975573:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c600, rc 0) 00000100:00100000:2.0:1785390111.975631:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:10291:x1872116847770112:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 387us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390111.975638:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:2.0:1785390111.979053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390111.979133:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847770368 00000100:00100000:0.0:1785390111.979141:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847770368 00000100:00100000:0.0:1785390111.979197:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1785390111.979207:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:10291:x1872116847770368:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390111.979226:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390111.979256:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecfc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfa2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.979346:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecfcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.979358:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecfcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.979370:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecfcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390111.979379:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1785390111.979490:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ecfc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.979507:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecfcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa2 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390111.979516:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:0.0:1785390111.979519:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390111.979557:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717400, rc 0) 00000100:00100000:0.0:1785390111.979610:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10291:x1872116847770368:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 404us (565us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1785390111.979617:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1785390111.987008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390111.990567:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847770624 00000100:00100000:2.0:1785390111.990581:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847770624 00000100:00100000:2.0:1785390111.990648:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1785390111.990657:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10291:x1872116847770624:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390111.990694:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390111.990714:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ecfdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfa9 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.991039:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ecfe4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.991055:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ecfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.991067:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ecfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390111.991079:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1785390111.993720:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ecfdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa9 expref: 21 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.993762:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ecfe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa9 expref: 20 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390111.993772:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:2.0:1785390111.993775:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785390111.993779:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121da00, rc 0) 00000100:00100000:2.0:1785390111.993862:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10291:x1872116847770624:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 3205us (6872us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1785390111.993871:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:3.0:1785390111.994452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390111.994869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847770752 00000100:00100000:1.0:1785390111.994877:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847770752 00000100:00100000:1.0:1785390111.994931:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1785390111.994941:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:2360:x1872116847770752:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390111.994955:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390111.994984:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ecfcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa2 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390111.995008:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:1.0:1785390111.995013:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390111.995045:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:2360:x1872116847770752:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 107us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390111.995053:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1785390112.004247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390112.004353:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847770880 00000100:00100000:0.0:1785390112.004362:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847770880 00000100:00100000:0.0:1785390112.004415:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1785390112.004424:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847770880:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:0.0:1785390112.004478:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.004498:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.004507:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390112.004512:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390112.004516:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.004578:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.004592:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 7 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390112.004605:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1872116879271296:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390112.004682:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390112.015297:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.015440:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847771008 00000100:00100000:1.0:1785390112.015449:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847771008 00002000:00100000:1.0:1785390112.015490:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8cf5182f9c00 x1872116847771008/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:98/0 lens 504/0 e 0 to 0 dl 1785390123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390112.015502:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf5182f9c00 with x1872116847771008 ext(0->12) 00010000:00010000:1.0:1785390112.015511:0:6602:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 8 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.015566:0:6602:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 8 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785390112.015575:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cf5182f9c00 00000100:00100000:1.0:1785390112.015595:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1785390112.015605:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847771008:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:0.0:1785390112.016223:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1872116879271296:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390112.016244:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1785390112.140694:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000100:00100000:0.0:1785390112.141308:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2359:x1872116847771008:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 125699us (126015us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1785390112.141337:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:0.0:1785390112.141349:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8cf5182f9c00 x1872116847771008/t4294967299(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:98/0 lens 504/448 e 0 to 0 dl 1785390123 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785390112.141360:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf5182f9c00 with x1872116847771008 ext(0->12) 00010000:00010000:0.0:1785390112.141370:0:6602:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 9 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.141389:0:6602:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 9 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390112.141398:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cf5182f9c00 00000100:00100000:0.0:1785390112.144966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390112.145083:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847771136 00000100:00100000:2.0:1785390112.145093:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847771136 00010000:00010000:2.0:1785390112.145138:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 9 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390112.145179:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1785390112.145197:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2360:x1872116847771136:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390112.145211:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785390112.145228:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785390112.145231:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1785390111 00002000:00010000:2.0:1785390112.145234:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1785390111 00002000:00010000:2.0:1785390112.145237:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1785390111 00010000:00010000:2.0:1785390112.145243:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 9 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145256:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 9 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145278:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ecfa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf8d expref: 9 pid: 6597 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145294:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390112.145299:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390112.145305:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145315:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145352:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390112.145392:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847771136:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 196us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390112.145399:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00010000:00010000:2.0:1785390112.145422:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145432:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145454:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145463:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145472:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145478:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390112.145482:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145491:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145514:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.145541:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001330bb2d/0x33dffe75ff5ecff2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390112.145583:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847770880:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 141161us (141345us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390112.145592:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:2.0:1785390112.148248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390112.148649:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847771392 00000100:00100000:3.0:1785390112.148659:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847771392 00000100:00100000:3.0:1785390112.148710:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:3.0:1785390112.148721:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:10291:x1872116847771392:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:3.0:1785390112.149071:0:5805:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ecfe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa9 expref: 19 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390112.149390:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1785390112.149447:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000040:00080000:2.0:1785390112.150686:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1785390112.151457:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1785390112.151833:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390112.151852:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 23 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390112.151861:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390112.151899:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 23 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390112.151913:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 23 pid: 5802 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390112.151929:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1872116879271424:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390112.153149:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15d80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390112.170506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.171850:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847771520 00000100:00100000:1.0:1785390112.171860:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847771520 00010000:00010000:1.0:1785390112.171900:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 24 pid: 5802 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390112.171973:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:1.0:1785390112.171983:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:2359:x1872116847771520:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390112.172009:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390112.172017:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 24 pid: 5802 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.172030:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 24 pid: 5802 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.172051:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:1.0:1785390112.172057:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.172066:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.172074:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.172092:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390112.172139:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:2359:x1872116847771520:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 159us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390112.172147:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00010000:00010000:3.0:1785390112.174725:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ecf89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf7f expref: 23 pid: 5802 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390112.175007:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1872116879271424:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390112.175038:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.178334:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.178351:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390112.178482:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1785390112.181499:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1785390112.181945:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879271552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785390112.182022:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390112.183280:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803300 going to sleep for 11 seconds 00000100:00100000:2.0:1785390112.187325:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879271552 00000100:00100000:2.0:1785390112.187338:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879271552 00000100:00080000:0.0:1785390112.187429:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390112.187469:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390112.187478:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879271552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785390112.187599:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879271552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390112.187606:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785390112.187695:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879271552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1785390112.188361:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1785390112.188431:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879271680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785390112.188465:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390112.192511:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390112.195669:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879271680 00000100:00100000:3.0:1785390112.195684:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879271680 00000100:00100000:0.0:1785390112.196740:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390112.196759:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879271680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785390112.197729:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1872116879271680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 977us (9259us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1785390112.197737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390112.197806:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879271680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785390112.200838:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1785390112.200934:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.200957:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.200965:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.200970:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390112.200975:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.200982:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.201008:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:1.0:1785390112.201011:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1785390112.201015:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.201021:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ecff9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785390112.201221:0:5805:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1785390112.201417:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1785390112.201427:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420755902025ns, next at 421755900293ns, rc = 0 00000001:00080000:1.0:1785390112.201433:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1785390112.201466:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a900) 00010000:00010000:1.0:1785390112.201468:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785390112.201476:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ecfe4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfa9 expref: 27 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390112.201625:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:10291:x1872116847771392:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 52905us (53382us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1785390112.201634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000020:00080000:1.0:1785390112.201639:0:5805:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1785390112.204283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.204390:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847771648 00000100:00100000:1.0:1785390112.204397:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847771648 00000100:00100000:1.0:1785390112.204445:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1785390112.204453:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:10291:x1872116847771648:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390112.204474:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390112.204492:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfb0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.204556:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed000 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfb0 expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.204569:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed000 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfb0 expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.204585:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390112.204588:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390112.204591:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4c00, rc 0) 00000100:00100000:1.0:1785390112.204630:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:10291:x1872116847771648:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 177us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390112.204636:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1785390112.207504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390112.207658:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847771904 00000100:00100000:3.0:1785390112.207665:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847771904 00000100:00100000:3.0:1785390112.207728:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:3.0:1785390112.207738:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5087cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:10291:x1872116847771904:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390112.208073:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5087cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:10291:x1872116847771904:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 337us (574us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1785390112.208080:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00010000:00010000:0.0:1785390112.214687:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390112.328932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.329168:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847772160 00000100:00100000:1.0:1785390112.329200:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847772160 00000100:00100000:1.0:1785390112.329254:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1785390112.329264:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:10301:x1872116847772160:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390112.329288:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390112.329307:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfb7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390112.329414:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1785390112.329517:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed007 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfb7 expref: 30 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.329557:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:1.0:1785390112.329560:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390112.329566:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfb7 expref: 30 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.329579:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390112.329636:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:10301:x1872116847772160:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 374us (713us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1785390112.329642:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1785390112.337972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390112.338077:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847772288 00000100:00100000:0.0:1785390112.338087:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847772288 00000100:00100000:0.0:1785390112.338146:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1785390112.338156:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:10301:x1872116847772288:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1785390112.338242:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338259:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338270:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338286:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338293:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338298:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338389:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338398:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338418:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390112.338462:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338474:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338480:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338486:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338491:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390112.338495:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338503:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338514:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390112.338517:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390112.338520:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338570:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed015 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338583:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338593:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338599:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338603:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390112.338606:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338611:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338618:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50896c200) 00010000:00010000:0.0:1785390112.338621:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390112.338624:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338629:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed01c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338641:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338646:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338651:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338655:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390112.338663:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338670:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338678:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:0.0:1785390112.338681:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390112.338683:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.338688:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed023 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390112.338765:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:10301:x1872116847772288:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 610us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390112.338773:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1785390112.341852:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.341934:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847772544 00000100:00100000:1.0:1785390112.341943:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847772544 00000100:00100000:1.0:1785390112.341999:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390112.342009:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:10301:x1872116847772544:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390112.342236:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:10301:x1872116847772544:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 227us (390us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1785390112.342259:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1785390112.411957:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.412085:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847772800 00000100:00100000:1.0:1785390112.412095:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847772800 00000100:00100000:1.0:1785390112.412148:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1785390112.412157:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:10304:x1872116847772800:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390112.412181:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390112.412208:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed02a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfbe expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412278:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412292:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412304:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412318:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412325:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412331:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412447:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412470:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412477:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390112.412487:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1785390112.412612:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412620:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412626:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412631:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390112.412635:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412643:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412653:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390112.412656:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390112.412660:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412667:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412679:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412692:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412698:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412702:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390112.412706:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412712:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412721:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf510c5a900) 00010000:00010000:1.0:1785390112.412723:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390112.412726:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412732:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412780:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed02a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412793:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 32 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.412801:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390112.412804:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390112.412811:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5a00, rc 0) 00000100:00100000:1.0:1785390112.412869:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:10304:x1872116847772800:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 713us (933us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1785390112.412877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1785390112.423706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390112.423817:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847772928 00000100:00100000:0.0:1785390112.423828:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847772928 00000100:00100000:0.0:1785390112.423888:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1785390112.423899:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:10304:x1872116847772928:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1785390112.423983:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424012:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424023:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424051:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424074:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424080:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424087:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390112.424091:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424099:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424111:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:0.0:1785390112.424114:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785390112.424118:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390112.424124:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed04d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390112.424207:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:10304:x1872116847772928:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 309us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390112.424215:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:3.0:1785390112.441377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.441598:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847773184 00000100:00100000:1.0:1785390112.441608:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847773184 00000100:00100000:1.0:1785390112.441658:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1785390112.441666:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:10304:x1872116847773184:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390112.441884:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:10304:x1872116847773184:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 218us (516us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1785390112.441892:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1785390112.904251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.904682:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847773440 00000100:00100000:1.0:1785390112.904693:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847773440 00000100:00100000:1.0:1785390112.904757:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:1.0:1785390112.904768:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:10335:x1872116847773440:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1785390112.904791:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390112.904810:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfc5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.904897:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed05b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.904911:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.904924:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed05b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390112.904934:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1785390112.905096:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfc5 expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.905135:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed05b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfc5 expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390112.905144:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390112.905147:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390112.905150:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4400, rc 0) 00000100:00100000:1.0:1785390112.905215:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10335:x1872116847773440:12345-192.168.202.54@tcp:101:cat.0 Request processed in 449us (973us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1785390112.905222:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1785390112.921571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390112.921641:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847773696 00000100:00100000:1.0:1785390112.921650:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847773696 00000100:00100000:1.0:1785390112.921697:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1785390112.921706:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10335:x1872116847773696:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:1.0:1785390112.921971:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:10335:x1872116847773696:12345-192.168.202.54@tcp:35:cat.0 Request processed in 266us (408us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1785390112.921978:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1785390112.926727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390112.926872:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847773824 00000100:00100000:2.0:1785390112.926881:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847773824 00000100:00100000:2.0:1785390112.926950:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1785390112.926960:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e06a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:2357:x1872116847773824:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390112.926975:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390112.927009:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed05b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfc5 expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390112.927029:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:2.0:1785390112.927034:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390112.927089:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e06a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:2357:x1872116847773824:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 130us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390112.927095:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:2.0:1785390113.090119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390113.090277:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774080 00000100:00100000:0.0:1785390113.090287:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774080 00000100:00100000:0.0:1785390113.090365:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1785390113.090375:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10341:x1872116847774080:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:0.0:1785390113.090398:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390113.090416:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785390113.090444:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ecfc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf9b expref: 35 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.090464:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390113.090469:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390113.090481:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed069 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfcc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.090623:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.090636:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.090643:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.090673:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.090686:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 35 pid: 5802 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390113.090700:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879271808:192.168.202.54@tcp:104: 00000100:00080000:2.0:1785390113.090918:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390113.091280:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390113.100119:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879271808:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390113.100148:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390113.101631:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390113.101709:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774208 00000100:00100000:1.0:1785390113.101717:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774208 00010000:00010000:1.0:1785390113.101766:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 36 pid: 5802 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390113.101802:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1785390113.101812:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:2359:x1872116847774208:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390113.101827:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390113.101844:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 36 pid: 5802 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.101856:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 36 pid: 5802 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.101877:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed03f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfbe expref: 36 pid: 5802 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.101892:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390113.101897:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.101907:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.101913:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.101965:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390113.102045:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:2359:x1872116847774208:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 234us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390113.102054:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00010000:00010000:2.0:1785390113.102635:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.102644:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390113.102662:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1785390113.102827:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed069 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.102856:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.102864:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:2.0:1785390113.102867:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785390113.102869:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717200, rc 0) 00000100:00100000:2.0:1785390113.102905:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10341:x1872116847774080:12345-192.168.202.54@tcp:101:dd.0 Request processed in 12531us (12794us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1785390113.102911:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1785390113.106646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390113.106711:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774464 00000100:00100000:0.0:1785390113.106719:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774464 00000100:00100000:0.0:1785390113.106772:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:0.0:1785390113.106780:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10341:x1872116847774464:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:0.0:1785390113.107036:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.107051:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.107061:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785390113.107106:0:7121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1785390113.107129:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d6adf17 reply state 00000000f18bfe23 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390113.107139:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785390113.107232:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:10341:x1872116847774464:12345-192.168.202.54@tcp:36:dd.0 Request processed in 452us (592us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1785390113.107238:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000020:00080000:0.0:1785390113.107242:0:7121:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785390113.114634:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.114653:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.114660:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.114665:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390113.114670:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.114678:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.114694:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:2.0:1785390113.114697:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390113.114716:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.114722:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed07e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390113.199632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390113.199676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390113.199713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390113.199807:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774848 00000100:00100000:3.0:1785390113.199817:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774848 00000100:00100000:3.0:1785390113.199886:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:3.0:1785390113.199897:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847774848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390113.199974:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847774848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390113.199992:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:1.0:1785390113.200132:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774592 00000100:00100000:1.0:1785390113.200136:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774592 00000100:00100000:1.0:1785390113.200171:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:1.0:1785390113.200183:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847774592:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390113.200214:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847774592:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390113.200236:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 306 00000100:00100000:0.0:1785390113.200343:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774720 00000100:00100000:0.0:1785390113.200349:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774720 00000100:00100000:0.0:1785390113.200390:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:0.0:1785390113.200398:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53596d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847774720:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390113.200434:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53596d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847774720:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 38us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390113.200454:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00080000:2.0:1785390113.201265:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390113.201270:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785390113.237754:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390113.684189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390113.684579:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847774976 00000100:00100000:0.0:1785390113.684589:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847774976 00000100:00100000:0.0:1785390113.684646:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1785390113.684655:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+37:10355:x1872116847774976:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:0.0:1785390113.684680:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390113.684700:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfd3 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684763:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684777:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684790:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684804:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684812:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684818:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684924:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684955:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.684964:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.685009:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.685024:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 38 pid: 5803 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390113.685038:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879271936:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390113.685132:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390113.689316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390113.689428:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879271936:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390113.689452:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390113.691366:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847775232 00000100:00100000:1.0:1785390113.691379:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847775232 00000100:00100000:1.0:1785390113.691442:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1785390113.691452:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:5579:x1872116847775232:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785390113.691802:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:5579:x1872116847775232:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 351us (2492us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1785390113.691811:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1785390113.694133:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390113.694299:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847775360 00000100:00100000:1.0:1785390113.694307:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847775360 00010000:00010000:1.0:1785390113.694338:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 40 pid: 5803 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390113.694379:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1785390113.694387:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:2358:x1872116847775360:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390113.694398:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390113.694405:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 40 pid: 5803 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.694418:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 40 pid: 5803 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.694438:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed070 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfcc expref: 40 pid: 5803 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.694454:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390113.694471:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.694678:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.694688:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390113.695599:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390113.695651:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:2358:x1872116847775360:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1264us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390113.695661:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00010000:00010000:2.0:1785390113.705791:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.705810:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390113.706267:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785390113.706272:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390113.706315:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706331:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706342:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706367:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706374:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706380:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390113.706384:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706392:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706408:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390113.706411:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390113.706416:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706423:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed08c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706439:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706446:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706452:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706457:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390113.706466:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706473:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706648:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50896c200) 00010000:00010000:2.0:1785390113.706652:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390113.706656:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706663:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706708:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfd3 expref: 39 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706723:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfd3 expref: 38 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390113.706730:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:2.0:1785390113.706733:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390113.706735:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:2.0:1785390113.707321:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:10355:x1872116847774976:12345-192.168.202.54@tcp:101:stat.0 Request processed in 22665us (23139us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390113.707330:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1785390113.920840:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390113.921035:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847775616 00000100:00100000:3.0:1785390113.921044:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847775616 00000100:00100000:3.0:1785390113.921099:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:3.0:1785390113.921108:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:10360:x1872116847775616:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:3.0:1785390113.921161:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390113.921196:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed09a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfd3 expref: 38 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390113.921231:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:3.0:1785390113.921236:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390113.921418:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390113.921431:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390113.921440:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390113.921490:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1785390113.921511:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000186be2cb reply state 0000000010128812 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390113.921518:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390113.921645:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:10360:x1872116847775616:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 537us (821us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1785390113.921651:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000020:00080000:3.0:1785390113.921655:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785390113.927352:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.927369:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.927377:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.927384:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390113.927388:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.927397:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.927425:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:0.0:1785390113.927428:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390113.927433:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390113.927440:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed0a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.263842:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390114.305237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390114.305329:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847775744 00000100:00100000:3.0:1785390114.305339:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847775744 00000100:00100000:3.0:1785390114.305393:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1785390114.305402:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:10375:x1872116847775744:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:3.0:1785390114.305424:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390114.305444:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfda expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305563:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305579:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305591:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305606:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305614:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305622:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305708:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305716:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.305723:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390114.306382:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1785390114.306388:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390114.306409:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306430:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306438:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306444:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306451:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306456:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390114.306460:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306467:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306480:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390114.306483:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390114.306487:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306493:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed0af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306507:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306513:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306608:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306613:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390114.306616:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306623:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306631:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf520a1da00) 00010000:00010000:3.0:1785390114.306634:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390114.306637:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306642:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306673:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 41 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306684:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 40 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.306691:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:3.0:1785390114.306693:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390114.306695:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785390114.306760:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:10375:x1872116847775744:12345-192.168.202.54@tcp:101:stat.0 Request processed in 1358us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390114.306779:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1785390114.544035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390114.544195:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847776000 00000100:00100000:2.0:1785390114.544205:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847776000 00000100:00100000:2.0:1785390114.544259:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1785390114.544268:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:10386:x1872116847776000:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390114.544302:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390114.544323:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfe1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390114.544430:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1785390114.544564:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe1 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.544578:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:2.0:1785390114.544581:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785390114.544586:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe1 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.544601:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c400, rc 0) 00000100:00100000:2.0:1785390114.544657:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+41:10386:x1872116847776000:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 390us (631us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1785390114.544664:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:0.0:1785390114.563620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390114.563714:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847776256 00000100:00100000:1.0:1785390114.563724:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847776256 00000100:00100000:1.0:1785390114.563789:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1785390114.563799:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+41:10386:x1872116847776256:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390114.564048:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:10386:x1872116847776256:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 250us (437us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1785390114.564056:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1785390114.705285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390114.705387:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847776512 00000100:00100000:2.0:1785390114.705396:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847776512 00000100:00100000:2.0:1785390114.705452:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1785390114.705462:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:10392:x1872116847776512:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390114.705486:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390114.705506:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed0d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfe8 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.705628:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.705660:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.705668:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.705701:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.705714:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 43 pid: 5802 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390114.705727:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535919180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879272064:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390114.705820:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503168180 going to sleep for 11 seconds 00000100:00100000:0.0:1785390114.709672:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535919180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879272064:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390114.709702:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390114.716855:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390114.717059:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847776640 00000100:00100000:2.0:1785390114.717069:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847776640 00010000:00010000:2.0:1785390114.717107:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 44 pid: 5802 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390114.717151:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:2.0:1785390114.717161:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:2360:x1872116847776640:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390114.717175:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390114.717182:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 44 pid: 5802 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.717196:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 44 pid: 5802 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.717234:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed0bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfda expref: 44 pid: 5802 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.717251:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:2.0:1785390114.717267:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.717276:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.717284:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.717316:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390114.717368:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:2360:x1872116847776640:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 208us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390114.717376:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:1.0:1785390114.717764:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.717781:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390114.717808:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1785390114.717936:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed0d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 44 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.717975:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 43 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.717983:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390114.717986:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785390114.717988:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c400, rc 0) 00000100:00100000:1.0:1785390114.718021:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:10392:x1872116847776512:12345-192.168.202.54@tcp:101:bash.0 Request processed in 12561us (12747us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1785390114.718029:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1785390114.728807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390114.728887:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847776896 00000100:00100000:2.0:1785390114.728896:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847776896 00000100:00100000:2.0:1785390114.728952:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:2.0:1785390114.728962:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:10392:x1872116847776896:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:2.0:1785390114.729219:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.729235:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390114.729246:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390114.729308:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1785390114.729334:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f6190dc reply state 000000007a9091d6 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390114.729343:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390114.729464:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:10392:x1872116847776896:12345-192.168.202.54@tcp:36:bash.0 Request processed in 480us (640us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1785390114.729471:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000020:00080000:2.0:1785390114.729477:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1785390114.737005:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.737023:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.737031:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.737036:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390114.737041:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.737048:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.737077:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390114.737080:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390114.737085:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.737092:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed0e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390114.748290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390114.748711:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847777024 00000100:00100000:3.0:1785390114.748720:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847777024 00000100:00100000:3.0:1785390114.748781:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1785390114.748790:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+45:10392:x1872116847777024:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390114.748813:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390114.748831:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bfef expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.748931:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.748945:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 46 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.748953:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.748995:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 46 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.749009:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 46 pid: 7121 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390114.749021:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879272192:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390114.749099:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15e40 going to sleep for 11 seconds 00000100:00100000:3.0:1785390114.756225:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879272192:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390114.756258:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390114.761311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390114.761697:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847777152 00000100:00100000:0.0:1785390114.761706:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847777152 00010000:00010000:0.0:1785390114.761758:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 47 pid: 7121 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390114.761797:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1785390114.761808:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:2359:x1872116847777152:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390114.761822:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390114.761828:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 47 pid: 7121 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.761841:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 47 pid: 7121 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.761881:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed0d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfe8 expref: 47 pid: 7121 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.761898:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:0.0:1785390114.761904:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.761913:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.761921:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390114.761958:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390114.762031:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:2359:x1872116847777152:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 223us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390114.762038:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00010000:00010000:3.0:1785390114.762275:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.762284:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390114.762330:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1785390114.762334:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390114.762354:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.762383:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfef expref: 46 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.762409:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfef expref: 45 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.762416:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:3.0:1785390114.762419:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390114.762421:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5200, rc 0) 00000100:00100000:3.0:1785390114.762469:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+45:10392:x1872116847777024:12345-192.168.202.54@tcp:101:bash.0 Request processed in 13679us (14189us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390114.762476:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1785390114.770329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390114.770403:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847777408 00000100:00100000:0.0:1785390114.770413:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847777408 00000100:00100000:0.0:1785390114.770463:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390114.770473:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5087c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+45:10392:x1872116847777408:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:0.0:1785390114.770702:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5087c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:10392:x1872116847777408:12345-192.168.202.54@tcp:35:bash.0 Request processed in 230us (381us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1785390114.770709:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1785390114.908714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390114.908827:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847777664 00000100:00100000:3.0:1785390114.908840:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847777664 00000100:00100000:3.0:1785390114.908921:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:3.0:1785390114.908952:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:10402:x1872116847777664:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390114.908997:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390114.909026:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bff6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390114.909191:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1785390114.909337:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bff6 expref: 48 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.909354:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390114.909358:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390114.909363:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bff6 expref: 48 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390114.909381:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4400, rc 0) 00000100:00100000:3.0:1785390114.909459:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:10402:x1872116847777664:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 509us (759us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1785390114.909467:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:2.0:1785390114.919759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390114.919877:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847777792 00000100:00100000:1.0:1785390114.919889:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847777792 00000100:00100000:1.0:1785390114.919975:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:1.0:1785390114.919988:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:10402:x1872116847777792:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:1.0:1785390114.920099:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920122:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920150:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920179:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920187:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920217:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920348:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920358:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920366:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390114.920420:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920436:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920444:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920452:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920459:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390114.920464:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920473:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920487:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390114.920496:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390114.920503:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920510:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed10a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920570:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920577:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920583:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920588:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390114.920591:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920597:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920605:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf510c5a900) 00010000:00010000:1.0:1785390114.920607:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390114.920610:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920615:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920631:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920644:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920651:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920657:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390114.920660:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920667:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920675:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390114.920678:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390114.920681:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390114.920688:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390114.920785:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:10402:x1872116847777792:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 798us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390114.920794:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:1.0:1785390114.923734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390114.923805:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847778048 00000100:00100000:0.0:1785390114.923816:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847778048 00000100:00100000:0.0:1785390114.923878:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:0.0:1785390114.923906:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:10402:x1872116847778048:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1785390114.925487:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:10402:x1872116847778048:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 1579us (1757us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1785390114.925498:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1785390115.024229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390115.024441:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847778304 00000100:00100000:3.0:1785390115.024456:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847778304 00000100:00100000:3.0:1785390115.024571:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1785390115.024585:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:10405:x1872116847778304:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390115.024618:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390115.024644:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed11f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1bffd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024740:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024775:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024789:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024808:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024815:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024822:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.024994:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.025004:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.025012:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390115.025024:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785390115.025147:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.025156:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.025163:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027030:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390115.027037:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027046:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027064:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390115.027067:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390115.027072:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027079:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027096:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027102:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027109:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027114:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390115.027116:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027121:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027153:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf520a1da00) 00010000:00010000:3.0:1785390115.027156:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390115.027165:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027460:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed12d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785390115.027647:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785390115.027694:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed11f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bffd expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027713:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bffd expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390115.027721:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:3.0:1785390115.027724:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390115.027727:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4e00, rc 0) 00000100:00100000:3.0:1785390115.027807:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10405:x1872116847778304:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 3226us (3591us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1785390115.027817:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:2.0:1785390115.039868:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390115.040187:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847778432 00000100:00100000:1.0:1785390115.040204:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847778432 00000100:00100000:1.0:1785390115.040260:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:1.0:1785390115.040270:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10405:x1872116847778432:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1785390115.040355:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040372:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040384:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040410:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040418:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040425:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040431:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390115.040436:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040444:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040454:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390115.040457:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390115.040462:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.040468:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390115.040583:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10405:x1872116847778432:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 313us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390115.040591:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:1.0:1785390115.043222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390115.043363:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847778688 00000100:00100000:3.0:1785390115.043371:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847778688 00000100:00100000:3.0:1785390115.043427:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1785390115.043437:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10405:x1872116847778688:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390115.043668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10405:x1872116847778688:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 231us (451us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1785390115.043675:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1785390115.049397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390115.049478:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847778816 00000100:00100000:1.0:1785390115.049493:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847778816 00000100:00100000:1.0:1785390115.049591:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1785390115.049604:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:2360:x1872116847778816:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390115.049624:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390115.049653:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bffd expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.049676:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:1.0:1785390115.049681:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390115.049748:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:2360:x1872116847778816:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 147us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390115.049755:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00010000:00010000:0.0:1785390115.286366:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390115.375603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390115.377047:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847779072 00000100:00100000:0.0:1785390115.377059:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847779072 00000100:00100000:0.0:1785390115.377127:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:0.0:1785390115.377136:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10423:x1872116847779072:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1785390115.377165:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390115.377188:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed149 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c004 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.377303:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed150 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.377317:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.377329:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed150 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390115.377339:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1785390115.377481:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed149 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c004 expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.377501:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed150 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c004 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.377785:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:0.0:1785390115.377788:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1785390115.377792:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716800, rc 0) 00000100:00100000:0.0:1785390115.377856:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10423:x1872116847779072:12345-192.168.202.54@tcp:101:cat.0 Request processed in 720us (2261us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1785390115.377863:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:2.0:1785390115.456059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390115.456137:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847779200 00000100:00100000:1.0:1785390115.456146:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847779200 00000100:00100000:1.0:1785390115.456206:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:1.0:1785390115.456215:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10424:x1872116847779200:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390115.456243:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390115.456262:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c00b expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.456321:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.456345:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.456358:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390115.456412:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1785390115.456415:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390115.456433:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.456455:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c00b expref: 54 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.456472:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c00b expref: 53 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.456480:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390115.456483:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390115.456486:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390115.456583:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10424:x1872116847779200:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 369us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390115.456590:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:2.0:1785390115.472723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390115.472797:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847779584 00000100:00100000:3.0:1785390115.472807:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847779584 00000100:00100000:3.0:1785390115.472856:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1785390115.472865:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10424:x1872116847779584:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390115.473190:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10424:x1872116847779584:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 325us (482us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1785390115.473203:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1785390115.494202:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390115.494397:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847779712 00000100:00100000:2.0:1785390115.494406:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847779712 00000100:00100000:2.0:1785390115.494470:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1785390115.494480:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10424:x1872116847779712:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:2.0:1785390115.494495:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1785390115.494518:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed0f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfef expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390115.494558:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c004 expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390115.494583:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bfb0 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390115.494592:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5aa00) 00010000:00010000:2.0:1785390115.494601:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390115.494655:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10424:x1872116847779712:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 177us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390115.494674:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1785390115.507128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390115.507384:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847779840 00000100:00100000:0.0:1785390115.507393:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847779840 00000100:00100000:0.0:1785390115.507448:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1785390115.507457:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10424:x1872116847779840:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:0.0:1785390115.507599:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.507615:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390115.507627:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785390115.509342:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785390115.512064:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1785390115.512187:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1785390115.512340:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10424:x1872116847779840:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 4879us (5225us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390115.512351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1785390115.575791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390115.576005:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847779968 00000100:00100000:1.0:1785390115.576017:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847779968 00000100:00100000:1.0:1785390115.576081:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:1.0:1785390115.576091:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10426:x1872116847779968:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390115.576112:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390115.576139:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c012 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576226:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576487:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576498:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576515:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576522:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576554:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576646:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576655:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576662:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390115.576713:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1785390115.576725:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390115.576743:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576761:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576770:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576777:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576784:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576790:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390115.576795:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576803:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576815:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390115.576818:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390115.576823:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576829:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed17a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576843:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576849:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576860:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576866:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390115.576870:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576877:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576885:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf510c5a900) 00010000:00010000:1.0:1785390115.576887:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390115.576890:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576896:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576924:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 53 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576937:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 52 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390115.576964:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:1.0:1785390115.576968:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390115.576970:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785390115.577031:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10426:x1872116847779968:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 941us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390115.577049:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1785390115.864332:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879272576:0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390115.864461:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1785390115.864468:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879272448:0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390115.864508:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879272960:0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390115.864585:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879272960 00000100:00100000:0.0:1785390115.864592:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879272960 00000100:00100000:0.0:1785390115.864640:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1785390115.864647:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879272960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864690:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879272960:12345-0@lo:400:kworker.0 Request processed in 44us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390115.864697:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1785390115.864727:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785390115.864756:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879272960:0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864779:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879272576 00000100:00100000:0.0:1785390115.864781:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879272576 00000100:00100000:0.0:1785390115.864808:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879272448 00000100:00100000:0.0:1785390115.864811:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879272448 00000100:00100000:0.0:1785390115.864828:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1785390115.864833:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879272576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864867:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879272576:12345-0@lo:400:kworker.0 Request processed in 34us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390115.864874:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1785390115.864886:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1785390115.864892:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879272448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864934:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879272448:12345-0@lo:400:kworker.0 Request processed in 43us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390115.864940:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1785390115.864965:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390115.864984:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879272448:0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.864994:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879272576:0@lo:400:kworker.0 00000100:00100000:1.0:1785390115.865127:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879272320:0@lo:400:kworker.0 00000100:00100000:1.0:1785390115.865161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390115.865189:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879272832:0@lo:400:kworker.0 00000100:00100000:1.0:1785390115.865209:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390115.865222:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390115.865226:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879272704:0@lo:400:kworker.0 00000100:00100000:1.0:1785390115.865245:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390115.865325:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879272832 00000100:00100000:3.0:1785390115.865329:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879272832 00000100:00100000:3.0:1785390115.865363:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785390115.865369:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879272832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390115.865404:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879272832:12345-0@lo:400:kworker.0 Request processed in 35us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390115.865430:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1785390115.865452:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879272832:0@lo:400:kworker.0 00000100:00080000:1.0:1785390115.865507:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390115.869127:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879272320 00000100:00100000:0.0:1785390115.869140:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879272320 00000100:00100000:0.0:1785390115.869203:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1785390115.869213:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879272320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.869299:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879272320:12345-0@lo:400:kworker.0 Request processed in 87us (4136us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390115.869307:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1785390115.869342:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879272704 00000100:00100000:0.0:1785390115.869346:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879272704 00000100:00100000:0.0:1785390115.869381:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1785390115.869387:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879272704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390115.869416:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879272704:12345-0@lo:400:kworker.0 Request processed in 29us (4171us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390115.869442:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1785390115.869458:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390115.869611:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879272704:0@lo:400:kworker.0 00000100:00100000:3.0:1785390115.869621:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879272320:0@lo:400:kworker.0 00000040:00080000:2.0:1785390116.245787:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785390116.245795:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390116.245835:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1785390116.245841:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785390116.245940:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879273088:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785390116.246047:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf503168b40 going to sleep for 11 seconds 00000100:00100000:1.0:1785390116.250579:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879273088:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785390116.251643:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.251944:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847780096 00000100:00100000:0.0:1785390116.251962:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847780096 00000100:00100000:0.0:1785390116.252006:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1785390116.252014:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780096:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1785390116.252133:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780096:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 Request processed in 118us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.252146:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1785390116.266609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.266678:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847780224 00000100:00100000:3.0:1785390116.266688:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847780224 00000100:00100000:3.0:1785390116.266743:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:3.0:1785390116.266753:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780224:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785390116.266783:0:5802:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785390116.266899:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780224:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 147us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390116.266921:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1785390116.278747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.278886:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847780352 00000100:00100000:2.0:1785390116.278895:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847780352 00000100:00100000:2.0:1785390116.278949:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:2.0:1785390116.278974:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780352:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785390116.279044:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279061:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279083:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279156:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279165:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279171:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279195:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279212:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279219:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390116.279253:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1785390116.279257:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390116.279268:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279279:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279286:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279293:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279307:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390116.279312:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279319:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279330:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:2.0:1785390116.279333:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390116.279337:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279344:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed18f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279356:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279361:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279368:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279373:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390116.279376:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279381:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279396:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cf50629b100) 00010000:00010000:2.0:1785390116.279398:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390116.279401:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279407:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed196 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279420:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279426:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279431:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279436:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390116.279439:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279445:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279450:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:2.0:1785390116.279452:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390116.279455:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.279462:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.279552:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780352:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 586us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390116.279559:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:2.0:1785390116.291397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.292605:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847780608 00000100:00100000:3.0:1785390116.292615:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847780608 00000100:00100000:3.0:1785390116.292670:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:3.0:1785390116.292679:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:10437:x1872116847780608:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390116.292698:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390116.292717:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c019 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292803:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292828:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292839:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390116.292849:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785390116.292931:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292939:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292946:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292971:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390116.292976:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.292991:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.293003:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:3.0:1785390116.293006:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390116.293010:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.293017:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.293056:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c019 expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.293065:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:3.0:1785390116.293067:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390116.293081:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c019 expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.293091:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4400, rc 0) 00000100:00100000:3.0:1785390116.293152:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10437:x1872116847780608:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 474us (1763us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1785390116.293160:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:3.0:1785390116.297391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.297469:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847780736 00000100:00100000:0.0:1785390116.297477:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847780736 00000100:00100000:0.0:1785390116.297549:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:0.0:1785390116.297559:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10437:x1872116847780736:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785390116.297589:0:5803:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785390116.297674:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10437:x1872116847780736:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.297691:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:0.0:1785390116.302965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.303180:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847780992 00000100:00100000:3.0:1785390116.303198:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847780992 00000100:00100000:3.0:1785390116.303257:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:3.0:1785390116.303267:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10437:x1872116847780992:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390116.303295:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390116.303298:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785390116.303323:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c00b expref: 53 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.303339:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390116.303344:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390116.303358:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed1b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c020 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785390116.303802:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1785390116.303998:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.304011:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.304021:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.304070:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed1b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c020 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.304084:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c020 expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.304092:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1da00) 00010000:00010000:3.0:1785390116.304094:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390116.304103:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4400, rc 0) 00000100:00100000:3.0:1785390116.304165:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10437:x1872116847780992:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 899us (1215us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1785390116.304173:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00010000:00010000:1.0:1785390116.310693:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390116.313888:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.314012:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847781248 00000100:00100000:0.0:1785390116.314021:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847781248 00000100:00100000:0.0:1785390116.314079:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:0.0:1785390116.314089:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10437:x1872116847781248:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785390116.314145:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390116.314169:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed1c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c020 expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314187:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1da00) 00010000:00010000:0.0:1785390116.314198:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390116.314230:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314243:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314262:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314306:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314314:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314320:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314384:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314392:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314398:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314404:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390116.314408:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314416:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314423:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390116.314426:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390116.314429:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314440:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed1ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314449:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314455:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314461:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314466:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390116.314469:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314475:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314481:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc5cbd526 (ffff8cf50896c300) 00010000:00010000:0.0:1785390116.314484:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390116.314486:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.314492:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed1d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc5cbd526 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.314583:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10437:x1872116847781248:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 494us (701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785390116.314590:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:0.0:1785390116.329466:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.329729:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847781376 00000100:00100000:3.0:1785390116.329739:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847781376 00000100:00100000:3.0:1785390116.329793:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1785390116.329803:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10437:x1872116847781376:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390116.329828:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390116.329850:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed1dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c027 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.329882:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.329896:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.329908:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.330009:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed1dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.330024:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.330033:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:3.0:1785390116.330036:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785390116.330045:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:3.0:1785390116.330181:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10437:x1872116847781376:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 379us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390116.330189:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:0.0:1785390116.344278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.344339:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847781632 00000100:00100000:2.0:1785390116.344348:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847781632 00000100:00100000:2.0:1785390116.344401:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:2.0:1785390116.344410:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10437:x1872116847781632:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785390116.344485:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.344501:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.344512:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785390116.344812:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1785390116.346196:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424900671165ns, next at 425900667592ns, rc = 0 00000004:00010000:2.0:1785390116.346474:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085a22f98 reply state 000000005d019ffd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.346486:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390116.346586:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10437:x1872116847781632:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 2175us (2315us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1785390116.346594:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00010000:00010000:0.0:1785390116.367754:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.367772:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.367780:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.367786:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390116.367790:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.367799:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.367823:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:0.0:1785390116.367826:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1785390116.367831:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.367838:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed1ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.373431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.375683:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847781760 00000100:00100000:1.0:1785390116.375696:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847781760 00000100:00100000:1.0:1785390116.375744:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:1.0:1785390116.375753:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10437:x1872116847781760:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390116.375777:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390116.375797:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c02e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.375865:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.375879:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.375916:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:1.0:1785390116.375920:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390116.375924:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4c00, rc 0) 00000100:00100000:1.0:1785390116.375992:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10437:x1872116847781760:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 240us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390116.375999:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:3.0:1785390116.386247:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785390116.386269:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879273216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390116.386333:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390116.389027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.389497:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879273216 00000100:00100000:0.0:1785390116.389507:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879273216 00000100:00100000:0.0:1785390116.389564:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785390116.389573:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879273216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785390116.389604:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390116.389663:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879273216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.389671:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1785390116.389693:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847781888 00000100:00100000:0.0:1785390116.389696:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847781888 00000100:00100000:0.0:1785390116.389715:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:0.0:1785390116.389720:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1872116847781888:12345-192.168.202.54@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1785390116.389741:0:7936:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:0.0:1785390116.389765:0:7936:0:(genops.c:1406:class_connect()) connect: client db9e37b8-1bb4-4113-a95f-cdba66461e5f, cookie 0x33dffe75ff5ed1f8 00002000:00100000:0.0:1785390116.389774:0:7936:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db9e37b8-1bb4-4113-a95f-cdba66461e5f/ffff8cf5034c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1785390116.389784:0:7936:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1785390116.392621:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879273216:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1785390116.396595:0:7936:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1785390116.396756:0:7936:0:(import.c:65:import_set_state_nolock()) ffff8cf5034c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390116.397974:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2356:x1872116847781888:12345-192.168.202.54@tcp:8:lhsmtool_posix.0 Request processed in 8248us (8947us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.397985:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1785390116.422506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.422705:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847782016 00000100:00100000:0.0:1785390116.422715:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847782016 00000100:00100000:0.0:1785390116.423765:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:0.0:1785390116.423777:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:0:x1872116847782016:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1785390116.438044:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1785390116.488260:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000020:00080000:2.0:1785390116.488297:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf508803900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1785390116.488301:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf5354c8f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf50894bf00 00000020:00080000:2.0:1785390116.488305:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf5354c8a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf5034b0800 00000020:00080000:0.0:1785390116.488343:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:2.0:1785390116.488351:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1785390116.488372:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1785390116.488375:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1785390116.488485:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1785390116.488594:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879273344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785390116.488604:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879273472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1785390116.489161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1785390116.489423:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1785390116.489431:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000100:00100000:1.0:1785390116.490613:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879273472 00000100:00100000:1.0:1785390116.490622:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879273472 00000100:00100000:1.0:1785390116.490666:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1785390116.490675:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879273472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1785390116.490887:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879273472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (1726us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1785390116.490894:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1785390116.492586:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf511081180/2, rc 0, transno 4294967302 00000100:00100000:2.0:1785390116.492595:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879273472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1785390116.495509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390116.495597:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879273344 00000100:00100000:1.0:1785390116.495605:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879273344 00000100:00100000:1.0:1785390116.495648:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785390116.495657:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879273344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785390116.495686:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00000100:00100000:0.0:1785390116.495700:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:0:x1872116847782016:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 71922us (73199us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1785390116.495709:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00002000:00010000:1.0:1785390116.495718:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a6ae41f, atime: 0x6a6ae41f, ctime: 0x6a6ae41f, blocks: 0x1 00010000:00010000:1.0:1785390116.495727:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.495742:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1785390116.495752:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390116.495759:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.495777:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.495788:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.495796:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.495824:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390116.495830:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390116.495838:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.495848:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390116.495853:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.495863:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.495894:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.495908:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d144f71f/0x33dffe75ff5ed1ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.495928:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390116.495931:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390116.495933:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390116.496464:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879273344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 807us (958us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1785390116.496471:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:0.0:1785390116.496619:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf5182fb480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1785390116.496627:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879273344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785390116.503149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.503191:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847782272 00000100:00100000:1.0:1785390116.503210:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847782272 00000100:00100000:1.0:1785390116.503266:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:1.0:1785390116.503275:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:10437:x1872116847782272:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785390116.503612:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10437:x1872116847782272:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 337us (475us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1785390116.503620:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:0.0:1785390116.542311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.542811:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847782528 00000100:00100000:2.0:1785390116.542821:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847782528 00000100:00100000:2.0:1785390116.542869:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1785390116.542878:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10437:x1872116847782528:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785390116.543015:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10437:x1872116847782528:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 137us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390116.543023:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:0.0:1785390116.550626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.550728:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847782656 00000100:00100000:1.0:1785390116.550739:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847782656 00000100:00100000:1.0:1785390116.550796:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:1.0:1785390116.550819:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10437:x1872116847782656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390116.550840:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390116.550862:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c035 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.550938:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed20d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.550960:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.550973:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390116.551007:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390116.551023:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed20d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.551049:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c035 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.551068:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed20d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c035 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.551077:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:1.0:1785390116.551081:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785390116.551084:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5a00, rc 0) 00000100:00100000:1.0:1785390116.551239:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847782656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 421us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390116.551255:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1785390116.587318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.587446:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847782784 00000100:00100000:2.0:1785390116.587469:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847782784 00000100:00100000:2.0:1785390116.587545:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1785390116.587556:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847782784:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390116.587574:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390116.587595:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c03c expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390116.587626:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6ae424, blocks: 0x1 00010000:00010000:2.0:1785390116.587644:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1785390116.587648:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390116.587656:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 6 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.587674:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 6 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.587687:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c200, rc 0) 00000100:00100000:2.0:1785390116.587737:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847782784:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 183us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390116.587744:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:3.0:1785390116.595084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.595181:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783040 00000100:00100000:2.0:1785390116.595191:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783040 00000100:00100000:2.0:1785390116.595254:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1785390116.595264:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847783040:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785390116.595367:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847783040:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390116.595374:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1785390116.630129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.630219:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783168 00000100:00100000:0.0:1785390116.630229:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783168 00000100:00100000:0.0:1785390116.630281:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:0.0:1785390116.630289:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:10437:x1872116847783168:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390116.630307:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390116.630326:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c043 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.630367:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.630377:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390116.630381:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390116.630386:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.630417:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.630430:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 7 pid: 7936 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.630443:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1872116879273600:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390116.630519:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1785390116.644787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.644865:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783296 00000100:00100000:1.0:1785390116.644875:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783296 00010000:00010000:1.0:1785390116.644920:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 8 pid: 7936 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390116.644985:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:1.0:1785390116.644994:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e069450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847783296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390116.645009:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390116.645031:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 8 pid: 7936 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.645047:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 8 pid: 7936 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.645074:0:11040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390116.645079:0:11040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390116.645088:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.645110:0:11040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.645147:0:11040:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390116.645179:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11040:1872116879273728:192.168.202.54@tcp:105: 00000100:00100000:1.0:1785390116.645245:0:11040:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019540 going to sleep for 11 seconds 00010000:00010000:0.0:1785390116.645397:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd198452/0x33dffe75ff5ed214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c03c expref: 8 pid: 7936 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.645418:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1872116879273600:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390116.645442:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.645453:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717200, rc 0) 00000100:00100000:0.0:1785390116.645480:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:10437:x1872116847783168:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 15191us (15360us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.645488:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1785390116.654427:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11040:1872116879273728:192.168.202.54@tcp:105: 00010000:00010000:1.0:1785390116.654455:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390116.654511:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e069450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847783296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 9516us (9732us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390116.654544:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:0.0:1785390116.675835:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.675916:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783424 00000100:00100000:3.0:1785390116.675925:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783424 00002000:00100000:3.0:1785390116.675986:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cf50e156d80 x1872116847783424/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:102/0 lens 504/0 e 0 to 0 dl 1785390127 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785390116.675998:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50e156d80 with x1872116847783424 ext(0->8) 00002000:00010000:3.0:1785390116.676004:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50e156d80 00000100:00100000:3.0:1785390116.676037:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1785390116.676046:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847783424:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1785390116.676637:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2357:x1872116847783424:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 591us (811us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1785390116.676647:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:3.0:1785390116.676655:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cf50e156d80 x1872116847783424/t4294967303(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:102/0 lens 504/448 e 0 to 0 dl 1785390127 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785390116.676664:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50e156d80 with x1872116847783424 ext(0->8) 00002000:00010000:3.0:1785390116.676668:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50e156d80 00000100:00100000:3.0:1785390116.701077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.701155:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783552 00000100:00100000:0.0:1785390116.701164:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783552 00000100:00100000:0.0:1785390116.701225:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:0.0:1785390116.701234:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847783552:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1785390116.701350:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847783552:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.701358:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:0.0:1785390116.724321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.725233:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783680 00000100:00100000:2.0:1785390116.725244:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783680 00000100:00100000:2.0:1785390116.725306:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1785390116.725315:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847783680:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1785390116.873838:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847783680:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 148513us (149514us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390116.873852:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000001:00080000:2.0:1785390116.873885:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1785390116.873894:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1785390116.879925:0:11872:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390116.879933:0:11872:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390116.879986:0:11872:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1785390116.879991:0:11872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785390116.887500:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390116.887519:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879273856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390116.887599:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390116.887655:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879273856 00000100:00100000:3.0:1785390116.887662:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879273856 00000100:00100000:3.0:1785390116.887712:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1785390116.887722:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879273856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390116.887756:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390116.887806:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879273856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390116.887812:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1785390116.888145:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879273856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390116.889120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.895071:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847783936 00000100:00100000:3.0:1785390116.895082:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847783936 00000100:00100000:3.0:1785390116.895146:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:3.0:1785390116.895157:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847783936:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785390116.895207:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390116.895232:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed20d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c035 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.895248:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:3.0:1785390116.895252:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390116.895280:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.895293:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.895313:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785390116.895455:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013f01255 reply state 000000009e907801 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390116.895465:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390116.895592:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:10437:x1872116847783936:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 437us (6473us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1785390116.895599:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00010000:00010000:2.0:1785390116.905576:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.905593:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.905600:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.905606:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390116.905610:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.905618:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.905633:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:2.0:1785390116.905636:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390116.905640:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.905646:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed222 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.907355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.907569:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847784064 00000100:00100000:1.0:1785390116.907644:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847784064 00000100:00100000:1.0:1785390116.907694:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:1.0:1785390116.907704:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847784064:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1785390116.907960:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785390116.907963:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785390114 00002000:00010000:1.0:1785390116.907966:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785390111 00002000:00010000:1.0:1785390116.907968:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1785390116 -> 1785390114 00002000:00010000:1.0:1785390116.907970:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1785390116.908026:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847784064:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 322us (674us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1785390116.915275:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1785390116.916309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.916670:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847784320 00000100:00100000:2.0:1785390116.916679:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847784320 00000100:00100000:2.0:1785390116.916731:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1785390116.916741:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10437:x1872116847784320:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1785390116.916805:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.916820:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.916829:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.916858:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.916869:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 14 pid: 5804 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.916882:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879273984:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390116.916974:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390116.919443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390116.919477:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847784448 00000100:00100000:3.0:1785390116.919483:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847784448 00010000:00010000:3.0:1785390116.919515:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 15 pid: 5804 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390116.919563:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1785390116.919573:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:2360:x1872116847784448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390116.919586:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390116.919594:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 15 pid: 5804 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.919607:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 15 pid: 5804 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.919628:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:3.0:1785390116.919641:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.919651:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.919659:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.919677:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390116.919717:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:2360:x1872116847784448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 146us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390116.919727:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00010000:00010000:2.0:1785390116.920623:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed1e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c027 expref: 14 pid: 5804 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.920640:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879273984:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390116.920662:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920679:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920685:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920777:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920889:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920898:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920904:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390116.920908:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920916:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920927:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:2.0:1785390116.920930:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785390116.920934:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.920940:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed229 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.921165:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10437:x1872116847784320:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 4424us (4856us total) trans 0 rc -22/-22 00000100:00100000:2.0:1785390116.921179:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:3.0:1785390116.950328:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.951341:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847784576 00000100:00100000:1.0:1785390116.951351:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847784576 00000100:00100000:1.0:1785390116.951493:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1785390116.951505:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847784576:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785390116.951580:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.951600:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.951609:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390116.951613:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390116.951618:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.951649:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390116.951663:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 7 pid: 6597 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390116.951677:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1872116879274112:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390116.951752:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390116.957631:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1872116879274112:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390116.957659:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390116.960899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390116.962755:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847784704 00000100:00100000:2.0:1785390116.962767:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847784704 00010000:00010000:2.0:1785390116.962803:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.962848:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1785390116.962858:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847784704:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390116.962872:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390116.962894:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.962907:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.962928:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed21b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c043 expref: 8 pid: 6597 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.962940:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390116.962944:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390116.962962:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.962979:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.963013:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390116.963043:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963058:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390116.963063:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847784704:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 206us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390116.963070:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00010000:00010000:0.0:1785390116.963197:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963206:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963213:0:6598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963220:0:6598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390116.963223:0:6598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963232:0:6598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963247:0:6598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.963254:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006263475e/0x33dffe75ff5ed230 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.963308:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847784576:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 11806us (12988us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390116.963316:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:2.0:1785390116.976034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390116.978801:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847784960 00000100:00100000:0.0:1785390116.978815:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847784960 00000100:00100000:0.0:1785390116.978876:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:0.0:1785390116.978887:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10437:x1872116847784960:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1785390116.978979:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.978998:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.979011:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.979219:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.979231:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.979239:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.979273:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390116.979302:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 14 pid: 5802 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390116.979316:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53ff8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879274240:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390116.979399:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1785390116.989891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390116.989989:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53ff8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879274240:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390116.990014:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390116.990304:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785088 00000100:00100000:3.0:1785390116.990311:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785088 00010000:00010000:3.0:1785390116.990342:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 15 pid: 5802 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390116.990375:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:3.0:1785390116.990383:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:2360:x1872116847785088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390116.990395:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390116.990402:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 15 pid: 5802 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.990414:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 15 pid: 5802 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.990446:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed1f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c02e expref: 15 pid: 5802 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.990459:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:3.0:1785390116.990464:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.990473:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.990480:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390116.990506:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390116.990568:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2360:x1872116847785088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 185us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390116.990575:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00010000:00010000:2.0:1785390116.990900:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390116.990908:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390116.991087:0:7121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1785390116.991295:0:7121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1785390116.991338:0:7121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1785390116.991418:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7121:1872116879274368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785390116.991458:0:7121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390116.991482:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0480 going to sleep for 11 seconds 00000100:00100000:3.0:1785390116.991635:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879274368 00000100:00100000:3.0:1785390116.991640:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879274368 00000100:00100000:3.0:1785390116.991746:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785390116.991755:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7121:x1872116879274368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785390116.991821:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7121:x1872116879274368:12345-0@lo:1000:mdt00_003.0 Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390116.991828:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785390116.991872:0:7121:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1785390116.991877:0:7121:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf511081180, transno 4294967302 00000100:00100000:2.0:1785390116.991888:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7121:1872116879274368:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1785390116.992282:0:7121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1785390116.992322:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7121:1872116879274496:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785390116.992355:0:7121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390116.992729:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390116.992928:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879274496 00000100:00100000:1.0:1785390116.992933:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879274496 00000100:00100000:1.0:1785390116.992968:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785390116.992975:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7121:x1872116879274496:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1785390116.993158:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7121:x1872116879274496:12345-0@lo:1000:mdt00_003.0 Request processed in 182us (801us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1785390116.993165:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785390116.998657:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511082680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7121:1872116879274496:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1785390117.000575:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000589:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000603:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000609:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390117.000614:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000622:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000637:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf520a1d900) 00010000:00010000:3.0:1785390117.000640:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390117.000645:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000651:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed23e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000685:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000692:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000698:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000703:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390117.000705:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000719:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000727:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:3.0:1785390117.000729:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390117.000732:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000737:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed16c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000778:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000792:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000801:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000835:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390117.000848:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 17 pid: 7121 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390117.000862:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879274624:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390117.000942:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390117.015642:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879274624:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390117.015667:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390117.037427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390117.037837:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785216 00000100:00100000:0.0:1785390117.037846:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785216 00010000:00010000:0.0:1785390117.037897:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 18 pid: 7121 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390117.037931:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:0.0:1785390117.037940:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2360:x1872116847785216:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390117.037968:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390117.037975:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 18 pid: 7121 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.037987:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 18 pid: 7121 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.038005:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c012 expref: 18 pid: 7121 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.038020:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:0.0:1785390117.038025:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.038044:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.038052:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.038083:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390117.038127:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:2360:x1872116847785216:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 188us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390117.038134:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00080000:1.0:1785390117.038293:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785390117.038307:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038314:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038325:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038331:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038337:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038344:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390117.038348:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038354:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038362:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:1.0:1785390117.038370:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390117.038373:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038379:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed245 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038390:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038395:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038401:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038405:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390117.038408:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038413:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038419:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c500) 00010000:00010000:1.0:1785390117.038421:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785390117.038423:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390117.038428:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed237 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390117.038627:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:10437:x1872116847784960:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 59742us (62602us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1785390117.038642:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000020:00080000:1.0:1785390117.038645:0:7121:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1785390117.038959:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390117.038970:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390117.038994:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1785390117.038999:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785390117.060617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390117.060670:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785472 00000100:00100000:0.0:1785390117.060680:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785472 00000100:00100000:0.0:1785390117.060784:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1785390117.060796:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:10437:x1872116847785472:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1785390117.061429:0:5805:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1785390117.061520:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1785390117.061584:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.061600:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.061612:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.061630:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.061637:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.061643:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390117.061668:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390117.061829:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1785390117.061834:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10437:x1872116847785472:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 1040us (1222us total) trans 4294967362 rc 0/0 00010000:00010000:2.0:1785390117.061836:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390117.061842:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00010000:00010000:2.0:1785390117.061843:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1599300) 00000020:00080000:0.0:1785390117.061846:0:5805:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785390117.061847:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390117.061854:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390117.061870:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf50896ce00) 00010000:00010000:2.0:1785390117.061873:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785390117.061877:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390117.061883:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed24c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390117.061899:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390117.061901:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390117.061902:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390117.334997:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785390117.499275:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:0.0:1785390117.499305:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1785390117.499313:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1785390118.318814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390118.318923:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785600 00000100:00100000:3.0:1785390118.318961:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785600 00000100:00100000:3.0:1785390118.319022:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:3.0:1785390118.319031:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847785600:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390118.319298:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847785600:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 266us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390118.319306:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 308 00000100:00100000:0.0:1785390118.326984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390118.327230:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785728 00000100:00100000:3.0:1785390118.327239:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785728 00000100:00100000:3.0:1785390118.327294:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:3.0:1785390118.327303:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2359:x1872116847785728:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390118.327372:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2359:x1872116847785728:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 70us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390118.327379:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00010000:00010000:2.0:1785390118.357687:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390118.370442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390118.370488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390118.370576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390118.370659:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847786112 00000100:00100000:0.0:1785390118.370672:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847786112 00000100:00100000:0.0:1785390118.370762:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:0.0:1785390118.370774:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847786112:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390118.370871:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847786112:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 99us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390118.370880:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00080000:1.0:1785390118.371557:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390118.371915:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785984 00000100:00100000:2.0:1785390118.371928:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785984 00000100:00100000:2.0:1785390118.372028:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847785856 00000100:00100000:2.0:1785390118.372045:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847785856 00000100:00100000:0.0:1785390118.372262:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:0.0:1785390118.372274:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847785984:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390118.372364:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847785984:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 92us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390118.372374:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:2.0:1785390118.372910:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:2.0:1785390118.372918:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847785856:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390118.372984:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847785856:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 67us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390118.372992:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00080000:1.0:1785390118.377519:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1785390118.377541:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1785390119.068604:0:11925:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390119.068613:0:11925:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390119.068679:0:11925:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1785390119.068684:0:11925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785390119.262435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390119.262493:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847786368 00000100:00100000:3.0:1785390119.262502:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847786368 00000100:00100000:3.0:1785390119.262616:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1785390119.262626:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10455:x1872116847786368:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390119.262645:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390119.262665:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c04a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.262903:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed25a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.262917:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed25a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.263757:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed25a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390119.263780:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1785390119.264183:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c04a expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.264202:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed25a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c04a expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.264212:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390119.264215:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785390119.264219:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4400, rc 0) 00000100:00100000:3.0:1785390119.264275:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10455:x1872116847786368:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1650us (1849us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1785390119.264283:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00080000:0.0:1785390119.267979:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390119.271282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.271352:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847786496 00000100:00100000:0.0:1785390119.271362:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847786496 00000100:00100000:0.0:1785390119.271417:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1785390119.271426:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10455:x1872116847786496:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1785390119.271495:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271512:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271557:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271573:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271580:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271587:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271852:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271861:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271868:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390119.271901:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271912:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271919:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.271938:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272040:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.272044:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272052:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272063:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390119.272066:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.272070:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272082:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272092:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272098:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272104:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272109:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.272112:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272118:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272125:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50896cd00) 00010000:00010000:0.0:1785390119.272128:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.272130:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272136:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed26f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272149:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272155:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272166:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272171:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.272174:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272180:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272188:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf50896c300) 00010000:00010000:0.0:1785390119.272190:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.272192:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.272198:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.272313:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10455:x1872116847786496:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 887us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.272321:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:1.0:1785390119.330657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390119.330737:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847786752 00000100:00100000:3.0:1785390119.330746:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847786752 00000100:00100000:3.0:1785390119.330793:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:3.0:1785390119.330802:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10458:x1872116847786752:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390119.330822:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390119.330841:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed27d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c051 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.330905:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.330918:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.330962:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.330978:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.330985:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.330991:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331277:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331286:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331293:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390119.331302:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1785390119.331384:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331392:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331399:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331405:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390119.331414:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331422:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331433:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390119.331436:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390119.331440:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331447:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331458:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331465:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331471:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331476:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390119.331479:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331485:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331490:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf520a1df00) 00010000:00010000:3.0:1785390119.331492:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390119.331499:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331505:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed28b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331571:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed27d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331585:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.331592:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:3.0:1785390119.331594:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390119.331597:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785390119.331648:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10458:x1872116847786752:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 847us (999us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1785390119.331656:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:2.0:1785390119.341292:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390119.344714:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847786880 00000100:00100000:1.0:1785390119.344728:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847786880 00000100:00100000:1.0:1785390119.344814:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:1.0:1785390119.344824:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10458:x1872116847786880:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1785390119.344885:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344901:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344913:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344957:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344964:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344972:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344983:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390119.344987:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.344995:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.345007:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:1.0:1785390119.345010:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390119.345014:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.345020:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed2a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390119.345100:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10458:x1872116847786880:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 277us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390119.345107:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:0.0:1785390119.350296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.350865:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847787136 00000100:00100000:2.0:1785390119.350874:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847787136 00000100:00100000:2.0:1785390119.350959:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1785390119.350969:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5087cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10458:x1872116847787136:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1785390119.351188:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5087cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:10458:x1872116847787136:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 221us (899us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1785390119.351197:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00010000:00010000:1.0:1785390119.391227:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390119.426893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.426940:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847787392 00000100:00100000:0.0:1785390119.427201:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847787392 00000100:00100000:0.0:1785390119.427249:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:0.0:1785390119.427257:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:9977:x1872116847787392:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390119.427282:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390119.427301:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed2a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c058 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.427399:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.427413:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.427421:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.427450:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.427463:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 24 pid: 5804 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.427477:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e014000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879274752:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390119.427565:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390119.435580:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e014000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879274752:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390119.435608:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390119.436194:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.436304:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847787520 00000100:00100000:0.0:1785390119.436311:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847787520 00010000:00010000:0.0:1785390119.436345:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 25 pid: 5804 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.436383:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1785390119.436399:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+25:2359:x1872116847787520:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390119.436413:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390119.436420:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 25 pid: 5804 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.436432:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 25 pid: 5804 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.436452:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c051 expref: 25 pid: 5804 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.436465:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:0.0:1785390119.436470:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.436479:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.436487:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.436514:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390119.436576:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:2359:x1872116847787520:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 178us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.436584:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00010000:00010000:2.0:1785390119.436668:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.436677:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390119.436704:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1785390119.436833:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed2a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.436848:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.436867:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:2.0:1785390119.436869:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785390119.436872:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:2.0:1785390119.436894:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:9977:x1872116847787392:12345-192.168.202.54@tcp:101:bash.0 Request processed in 9638us (10011us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1785390119.436901:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:0.0:1785390119.447574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390119.447655:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847787776 00000100:00100000:1.0:1785390119.447665:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847787776 00000100:00100000:1.0:1785390119.447721:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:1.0:1785390119.447731:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:9977:x1872116847787776:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:1.0:1785390119.448147:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.448164:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.448176:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390119.448236:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1785390119.448259:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000faf6637e reply state 0000000007d79669 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390119.448268:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1785390119.448309:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1785390119.448429:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:9977:x1872116847787776:12345-192.168.202.54@tcp:36:bash.0 Request processed in 699us (863us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1785390119.448437:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000020:00080000:1.0:1785390119.448441:0:5803:0:(tgt_main.c:787:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1785390119.451986:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:3.0:1785390119.452075:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.452087:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.452096:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.452101:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390119.452106:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.452139:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.452155:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:3.0:1785390119.452157:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390119.452162:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.452168:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed2bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390119.452267:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847787904 00000100:00100000:1.0:1785390119.452275:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847787904 00000100:00100000:1.0:1785390119.452326:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:1.0:1785390119.452334:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:9977:x1872116847787904:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1785390119.452355:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390119.452369:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed2c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c05f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.452417:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c05f expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.452429:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c05f expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.452444:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:1.0:1785390119.452447:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390119.452449:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390119.452713:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:9977:x1872116847787904:12345-192.168.202.54@tcp:101:bash.0 Request processed in 378us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390119.452720:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:2.0:1785390119.455211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.455288:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847788032 00000100:00100000:0.0:1785390119.455295:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847788032 00000100:00100000:0.0:1785390119.455365:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1785390119.455385:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:9977:x1872116847788032:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390119.455399:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390119.455414:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c066 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390119.455436:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a6ae422, atime: 0x6a6ae41f, ctime: 0x6a6ae422, blocks: 0xb 00010000:00010000:0.0:1785390119.455453:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1785390119.455457:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390119.455465:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 7 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.455481:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 7 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.455492:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717200, rc 0) 00000100:00100000:0.0:1785390119.455600:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:9977:x1872116847788032:12345-192.168.202.54@tcp:101:bash.0 Request processed in 216us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.455607:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1785390119.463378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.463412:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847788160 00000100:00100000:0.0:1785390119.463422:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847788160 00002000:00010000:0.0:1785390119.463461:0:6602:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1785390119.463467:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50e015880 with x1872116847788160 ext(0->18446744073709551615) 00002000:00010000:0.0:1785390119.463478:0:6602:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50e015880. 00000100:00100000:0.0:1785390119.463503:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1785390119.463511:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847788160:12345-192.168.202.54@tcp:10:bash.0 00002000:00010000:0.0:1785390119.463798:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1785390119.463802:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1785390114 -> 1785390119 00002000:00010000:0.0:1785390119.463804:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1785390111 -> 1785390111 00002000:00010000:0.0:1785390119.463807:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1785390114 -> 1785390119 00002000:00010000:0.0:1785390119.463809:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1785390119.463857:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847788160:12345-192.168.202.54@tcp:10:bash.0 Request processed in 346us (487us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1785390119.463865:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00002000:00010000:0.0:1785390119.463868:0:6602:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1785390119.463871:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50e015880 with x1872116847788160 ext(0->18446744073709551615) 00002000:00010000:0.0:1785390119.463875:0:6602:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50e015880. 00000100:00100000:1.0:1785390119.541993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.542164:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847788288 00000100:00100000:0.0:1785390119.542175:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847788288 00000100:00100000:0.0:1785390119.542235:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:0.0:1785390119.542246:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:10471:x1872116847788288:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1785390119.542324:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542341:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542353:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542369:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542376:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542395:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542673:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542693:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542700:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390119.542736:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542747:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542752:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542758:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542764:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.542768:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542774:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542783:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390119.542791:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.542795:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542800:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed2d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542811:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542817:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542823:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542828:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.542830:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542835:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542840:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50896c700) 00010000:00010000:0.0:1785390119.542841:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.542844:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542850:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed2d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542861:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542870:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542876:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542881:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.542883:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542888:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542895:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:0.0:1785390119.542897:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.542900:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.542906:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed2df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.542981:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:10471:x1872116847788288:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 736us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.542988:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00000100:00100000:2.0:1785390119.588487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390119.588574:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847788544 00000100:00100000:3.0:1785390119.588583:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847788544 00000100:00100000:3.0:1785390119.588637:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:3.0:1785390119.588646:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:10475:x1872116847788544:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390119.588667:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390119.588696:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed2e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c06d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.588760:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.588773:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.588784:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.588798:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.588820:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.588827:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589228:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589237:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589245:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390119.589255:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1785390119.589337:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589345:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589352:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589357:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390119.589362:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589369:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589390:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390119.589393:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390119.589397:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589404:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed2ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589416:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589422:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589429:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589434:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390119.589437:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589442:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589448:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf520a1df00) 00010000:00010000:3.0:1785390119.589450:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390119.589453:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589459:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed2f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589502:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed2e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c06d expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589516:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c06d expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390119.589573:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:3.0:1785390119.589576:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1785390119.589579:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5e00, rc 0) 00000100:00100000:3.0:1785390119.589683:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:10475:x1872116847788544:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1037us (1204us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1785390119.589690:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 92 00000100:00100000:2.0:1785390119.593078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.593155:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847788672 00000100:00100000:0.0:1785390119.593164:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847788672 00000100:00100000:0.0:1785390119.593212:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1785390119.593221:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:10475:x1872116847788672:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1785390119.593275:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.593301:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.593311:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.593341:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.593355:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 30 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.593369:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879274880:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390119.593442:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390119.596677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.596849:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879274880:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390119.596872:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390119.597111:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847788928 00000100:00100000:1.0:1785390119.597166:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847788928 00000100:00100000:1.0:1785390119.597237:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1785390119.597246:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:5579:x1872116847788928:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1785390119.597508:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:5579:x1872116847788928:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 262us (836us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1785390119.597516:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1785390119.598873:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390119.598948:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847789056 00000100:00100000:0.0:1785390119.598954:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847789056 00010000:00010000:0.0:1785390119.598978:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 32 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.599012:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1785390119.599019:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:2360:x1872116847789056:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390119.599030:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390119.599048:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 32 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599059:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 32 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599080:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed2ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c058 expref: 32 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599093:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:0.0:1785390119.599098:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599108:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599126:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599149:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390119.599176:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:2360:x1872116847789056:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 157us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.599183:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00010000:00010000:0.0:1785390119.599202:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599210:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599227:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599244:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599251:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599257:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.599261:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599269:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599277:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:0.0:1785390119.599280:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785390119.599283:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.599289:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.599319:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:10475:x1872116847788672:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 6099us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.599326:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1785390119.601417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.601483:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847789312 00000100:00100000:2.0:1785390119.601489:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847789312 00000100:00100000:2.0:1785390119.601547:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:2.0:1785390119.601555:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:10475:x1872116847789312:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1785390119.601884:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:10475:x1872116847789312:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 329us (471us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1785390119.601892:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:3.0:1785390119.693261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.693376:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847789568 00000100:00100000:2.0:1785390119.693385:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847789568 00000100:00100000:2.0:1785390119.693441:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:2.0:1785390119.693450:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:10486:x1872116847789568:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1785390119.693474:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390119.693494:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ed310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c074 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693604:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693618:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693629:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693642:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693649:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693655:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693934:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ed325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693953:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ed325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.693962:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ed325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390119.693972:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1785390119.694053:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694061:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694074:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694079:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390119.694083:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694091:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694102:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390119.694105:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390119.694109:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694116:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694128:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694133:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694140:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694145:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121da00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390119.694148:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694162:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694169:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50629b300) 00010000:00010000:2.0:1785390119.694172:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390119.694175:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694181:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed31e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694220:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ed310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c074 expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694232:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ed325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c074 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.694240:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:2.0:1785390119.694242:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390119.694244:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121ce00, rc 0) 00000100:00100000:2.0:1785390119.694302:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:10486:x1872116847789568:12345-192.168.202.54@tcp:101:cat.0 Request processed in 852us (1047us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1785390119.694309:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:3.0:1785390119.705092:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390119.705241:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847789824 00000100:00100000:1.0:1785390119.705250:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847789824 00000100:00100000:1.0:1785390119.705301:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1785390119.705310:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:10486:x1872116847789824:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:1.0:1785390119.705698:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:10486:x1872116847789824:12345-192.168.202.54@tcp:35:cat.0 Request processed in 388us (613us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1785390119.705706:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:0.0:1785390119.729960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390119.730552:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847790080 00000100:00100000:1.0:1785390119.730562:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847790080 00000100:00100000:1.0:1785390119.730622:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:1.0:1785390119.730632:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:10487:x1872116847790080:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:1.0:1785390119.730705:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1785390119.730733:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ed325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c074 expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730777:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c06d expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730789:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed2c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c05f expref: 32 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730798:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf520a1d200) 00010000:00010000:1.0:1785390119.730809:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390119.730829:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730842:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730852:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730867:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730873:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.730879:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.731297:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.731306:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.731318:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390119.731903:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1785390119.731911:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428286386180ns, next at 429286384185ns, rc = 0 00010000:00010000:1.0:1785390119.732265:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732275:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732282:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732289:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732296:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732302:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732325:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390119.732341:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732347:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732352:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732363:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390119.732367:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732376:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732385:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a800) 00010000:00010000:1.0:1785390119.732387:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1785390119.732390:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732395:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed341 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732410:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732414:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732420:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732425:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390119.732428:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732432:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732446:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390119.732449:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390119.732452:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390119.732458:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed333 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390119.732466:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7ef8f14 reply state 00000000cb818b5e transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390119.732475:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390119.734935:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:10487:x1872116847790080:12345-192.168.202.54@tcp:36:rm.0 Request processed in 4289us (4982us total) trans 4294967375 rc 0/0 00010000:00010000:2.0:1785390119.735040:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390119.735048:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.735056:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390119.735072:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.735080:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.735092:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf510c5a800) 00010000:00010000:2.0:1785390119.735094:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785390119.735098:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.735104:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed348 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.735136:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390119.735138:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390119.735139:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390119.735211:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00010000:00010000:2.0:1785390119.749238:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.749255:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.749263:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.749269:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390119.749274:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.749282:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.749318:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf510c5a200) 00010000:00010000:2.0:1785390119.749321:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390119.749325:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.749332:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed33a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.793666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.793969:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847790336 00000100:00100000:2.0:1785390119.793979:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847790336 00000100:00100000:2.0:1785390119.794036:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:2.0:1785390119.794044:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:10493:x1872116847790336:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390119.794070:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390119.794091:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ed34f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c07b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794218:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794232:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794242:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794255:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794262:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794282:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785390119.794806:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1785390119.794961:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794971:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.794979:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795009:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795017:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795024:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795030:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121da00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390119.795033:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795040:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795051:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390119.795054:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390119.795065:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795072:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed356 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390119.795085:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065faeaaa reply state 00000000003e6716 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390119.795094:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785390119.795119:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ed34f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795133:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.795141:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:2.0:1785390119.795143:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390119.795145:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d400, rc 0) 00000100:00100000:2.0:1785390119.795202:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10493:x1872116847790336:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1158us (1545us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1785390119.795209:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00010000:00010000:0.0:1785390119.798763:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.798793:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.798801:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.798808:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390119.798813:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.798820:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.798834:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50629b300) 00010000:00010000:0.0:1785390119.798837:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390119.798842:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.798849:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed35d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.801496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.801615:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847790464 00000100:00100000:2.0:1785390119.801624:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847790464 00000100:00100000:2.0:1785390119.801668:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:2.0:1785390119.801676:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847790464:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390119.801703:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390119.801720:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c082 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390119.801761:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390119.801779:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1785390119.801783:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390119.801792:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.801809:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 6 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.801821:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121cc00, rc 0) 00000100:00100000:2.0:1785390119.801873:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847790464:12345-192.168.202.54@tcp:101:bash.0 Request processed in 197us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390119.801879:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:3.0:1785390119.805194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.805284:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847790592 00000100:00100000:2.0:1785390119.805292:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847790592 00000100:00100000:2.0:1785390119.805340:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:2.0:1785390119.805349:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:10493:x1872116847790592:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390119.805365:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390119.805380:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c089 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.805408:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.805434:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390119.805438:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390119.805444:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.805478:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.805492:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390119.805506:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5411a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1872116879275008:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390119.805617:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf52021ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390119.808176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390119.808273:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5411a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6599:1872116879275008:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390119.808301:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390119.808319:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121da00, rc 0) 00000100:00100000:2.0:1785390119.808363:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:10493:x1872116847790592:12345-192.168.202.54@tcp:101:bash.0 Request processed in 3015us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390119.808371:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:0.0:1785390119.808445:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847790720 00000100:00100000:0.0:1785390119.808451:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847790720 00010000:00010000:0.0:1785390119.808477:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.808510:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:0.0:1785390119.808517:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e06ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847790720:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390119.808562:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390119.808583:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.808595:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.808615:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ed372 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c082 expref: 7 pid: 6597 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.808629:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390119.808633:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390119.808641:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.808651:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390119.808677:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390119.808689:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879275136:192.168.202.54@tcp:105: 00000100:00100000:0.0:1785390119.808730:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390119.811778:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879275136:192.168.202.54@tcp:105: 00010000:00010000:0.0:1785390119.811800:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390119.811858:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e06ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847790720:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 3340us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390119.811868:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:3.0:1785390119.813130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390119.813199:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847790976 00000100:00100000:1.0:1785390119.813206:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847790976 00000100:00100000:1.0:1785390119.813251:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785390119.813259:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:10493:x1872116847790976:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:1.0:1785390119.813573:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10493:x1872116847790976:12345-192.168.202.54@tcp:35:bash.0 Request processed in 314us (456us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1785390119.813580:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:3.0:1785390120.114261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.114411:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847791104 00000100:00100000:0.0:1785390120.114420:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847791104 00000100:00100000:0.0:1785390120.114477:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:0.0:1785390120.114486:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:10509:x1872116847791104:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390120.114509:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390120.114563:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c090 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.114625:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.114639:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.114652:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390120.114707:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1785390120.114710:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390120.114729:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.114750:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c090 expref: 37 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.114765:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c090 expref: 36 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.114791:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390120.114794:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390120.114797:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717000, rc 0) 00000100:00100000:0.0:1785390120.114850:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:10509:x1872116847791104:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 365us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.114857:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:0.0:1785390120.122756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390120.124401:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847791360 00000100:00100000:2.0:1785390120.124412:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847791360 00000100:00100000:2.0:1785390120.124472:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:2.0:1785390120.124494:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:10509:x1872116847791360:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390120.124516:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390120.124576:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ed38e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c097 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.124668:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.124681:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.124693:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390120.124703:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1785390120.124813:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ed38e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c097 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.124831:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c097 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.124839:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:2.0:1785390120.124842:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390120.124845:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c800, rc 0) 00000100:00100000:2.0:1785390120.126125:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:10509:x1872116847791360:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1629us (3374us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1785390120.126134:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:3.0:1785390120.142228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.142981:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847791616 00000100:00100000:0.0:1785390120.142992:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847791616 00000100:00100000:0.0:1785390120.143058:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:0.0:1785390120.143069:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:10509:x1872116847791616:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390120.143091:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390120.143112:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c09e expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.143207:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.143222:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.143234:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390120.143247:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1785390120.143360:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c09e expref: 41 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.143392:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c09e expref: 40 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.143400:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:0.0:1785390120.143402:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1785390120.143406:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717c00, rc 0) 00000100:00100000:0.0:1785390120.143467:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:10509:x1872116847791616:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 400us (1247us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1785390120.143473:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1785390120.145812:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.145884:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847791744 00000100:00100000:0.0:1785390120.145891:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847791744 00000100:00100000:0.0:1785390120.145955:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:0.0:1785390120.145964:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:2360:x1872116847791744:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390120.145978:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390120.145997:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c097 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.146024:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:0.0:1785390120.146028:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390120.146077:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:2360:x1872116847791744:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 114us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.146084:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1785390120.176313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.182490:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847791872 00000100:00100000:0.0:1785390120.182504:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847791872 00000100:00100000:0.0:1785390120.182620:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:0.0:1785390120.182643:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847791872:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:0.0:1785390120.182690:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.182712:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785390120.182717:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1785390120.182721:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390120.182725:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390120.182729:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.182764:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.182779:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 6 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390120.182794:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf51f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879275264:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390120.182899:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15000 going to sleep for 11 seconds 00000100:00100000:0.0:1785390120.189658:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf51f10f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879275264:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390120.189688:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390120.203828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.204377:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847792000 00000100:00100000:0.0:1785390120.204386:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847792000 00002000:00100000:0.0:1785390120.204437:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cf5411a7800 x1872116847792000/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:106/0 lens 504/0 e 0 to 0 dl 1785390131 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785390120.204448:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf5411a7800 with x1872116847792000 ext(0->8) 00010000:00010000:0.0:1785390120.204457:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 7 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.204473:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 7 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390120.204481:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cf5411a7800 00000100:00100000:0.0:1785390120.204519:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1785390120.204552:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847792000:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:0.0:1785390120.205016:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2360:x1872116847792000:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 454us (1185us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1785390120.205025:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00002000:00100000:0.0:1785390120.205032:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cf5411a7800 x1872116847792000/t4294967302(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:106/0 lens 504/448 e 0 to 0 dl 1785390131 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785390120.205041:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf5411a7800 with x1872116847792000 ext(0->8) 00010000:00010000:0.0:1785390120.205047:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 9 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.205059:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 9 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390120.205067:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cf5411a7800 00000100:00100000:2.0:1785390120.229184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.229287:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847792128 00000100:00100000:1.0:1785390120.229296:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847792128 00010000:00010000:1.0:1785390120.229334:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 9 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.229398:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:1.0:1785390120.229407:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2359:x1872116847792128:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390120.229422:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1785390120.229441:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1785390120.229444:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1785390119 00002000:00010000:1.0:1785390120.229446:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1785390120 00002000:00010000:1.0:1785390120.229449:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1785390119 00010000:00010000:1.0:1785390120.229454:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 9 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.229468:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 9 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.229500:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ed379 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c089 expref: 9 pid: 6599 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.229518:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390120.229568:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390120.229574:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.229584:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.229617:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390120.229667:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229677:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.229679:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847792128:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 272us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.229687:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00010000:00010000:2.0:1785390120.229703:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229712:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229720:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229727:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390120.229731:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229740:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229752:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390120.229759:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed3b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390120.229809:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2357:x1872116847791872:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 47169us (53506us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390120.229817:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1785390120.245206:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.247108:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847792384 00000100:00100000:1.0:1785390120.247121:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847792384 00000100:00100000:1.0:1785390120.247186:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1785390120.247206:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5087c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:10509:x1872116847792384:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:1.0:1785390120.247272:0:5805:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c09e expref: 39 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390120.247501:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1785390120.247580:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1785390120.248071:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1785390120.248124:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.248140:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.248149:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.248184:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.248248:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 43 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.248264:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1872116879275392:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390120.248355:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019300 going to sleep for 11 seconds 00000100:00100000:1.0:1785390120.259977:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1872116879275392:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390120.260006:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390120.261124:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.262038:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847792512 00000100:00100000:0.0:1785390120.262049:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847792512 00010000:00010000:0.0:1785390120.262091:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 44 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390120.262126:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1785390120.262137:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:2359:x1872116847792512:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390120.262151:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390120.262158:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 44 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.262171:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 44 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.262200:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c07b expref: 44 pid: 5804 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.262219:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:0.0:1785390120.262225:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.262234:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.262242:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.262266:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390120.262319:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:2359:x1872116847792512:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 183us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.262339:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00010000:00010000:1.0:1785390120.262518:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.262545:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390120.262663:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1785390120.262878:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1785390120.262991:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879275520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785390120.263046:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390120.263069:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019900 going to sleep for 11 seconds 00000100:00100000:0.0:1785390120.263953:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879275520 00000100:00100000:0.0:1785390120.263961:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879275520 00000100:00100000:0.0:1785390120.264015:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1785390120.264033:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879275520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785390120.264104:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879275520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.264111:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785390120.264559:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390120.264667:0:5805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1785390120.264673:0:5805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1785390120.264692:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf5182fb480, transno 4294967301 00000100:00100000:1.0:1785390120.264745:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879275520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785390120.266667:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1785390120.266751:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53591aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879275648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785390120.271078:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390120.271165:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019300 going to sleep for 11 seconds 00000100:00100000:0.0:1785390120.286369:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879275648 00000100:00100000:0.0:1785390120.286383:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879275648 00000100:00100000:0.0:1785390120.286438:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785390120.286448:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879275648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1785390120.288308:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1872116879275648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1856us (17232us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1785390120.288319:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785390120.305970:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53591aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879275648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1785390120.306076:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1785390120.306132:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.306156:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.306164:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.306169:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390120.306184:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.306196:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.306211:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:1.0:1785390120.306213:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1785390120.306218:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.306223:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed3bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785390120.306405:0:5805:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1785390120.306509:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1785390120.306542:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428861016954ns, next at 429860992249ns, rc = 0 00000001:00080000:1.0:1785390120.306548:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1785390120.306580:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:1.0:1785390120.306582:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785390120.306589:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c09e expref: 47 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.306710:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5087c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:10509:x1872116847792384:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 59505us (61511us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1785390120.306719:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000020:00080000:1.0:1785390120.306723:0:5805:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1785390120.311397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.312336:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847792640 00000100:00100000:1.0:1785390120.312346:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847792640 00000100:00100000:1.0:1785390120.312409:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:1.0:1785390120.312419:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:10509:x1872116847792640:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390120.312443:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390120.312466:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed3c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0a5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.312539:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0a5 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.312553:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0a5 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.312570:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.312573:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390120.312576:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390120.312628:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:10509:x1872116847792640:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 210us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.312635:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:3.0:1785390120.320300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390120.320425:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847792896 00000100:00100000:2.0:1785390120.320436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847792896 00000100:00100000:2.0:1785390120.320497:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1785390120.320507:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:10509:x1872116847792896:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390120.321445:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:10509:x1872116847792896:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 936us (1151us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1785390120.321463:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00010000:00010000:1.0:1785390120.407064:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390120.442672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.442807:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847793024 00000100:00100000:0.0:1785390120.442822:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847793024 00000100:00100000:0.0:1785390120.442899:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:0.0:1785390120.442913:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:10519:x1872116847793024:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1785390120.443061:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443085:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443101:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443143:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443151:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443159:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443396:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443407:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443421:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390120.443485:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443499:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443507:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443515:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443558:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390120.443563:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443580:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443593:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390120.443597:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390120.443602:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443610:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed3cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443638:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443654:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443661:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443677:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390120.443680:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443687:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443694:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50896c700) 00010000:00010000:0.0:1785390120.443697:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390120.443700:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443735:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed3d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443771:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443778:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443785:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443797:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390120.443800:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443806:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443813:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390120.443815:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390120.443824:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.443830:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed3db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390120.444005:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:10519:x1872116847793024:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 1080us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.444014:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:2.0:1785390120.507633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390120.507732:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847793280 00000100:00100000:3.0:1785390120.507743:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847793280 00000100:00100000:3.0:1785390120.507807:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:3.0:1785390120.507818:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:10522:x1872116847793280:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390120.507839:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390120.507861:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed3e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0ac expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.507971:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.507986:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.507999:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508014:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508021:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508027:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508169:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508183:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508190:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390120.508201:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1785390120.508298:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508306:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508312:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508317:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390120.508321:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508328:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508338:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390120.508341:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390120.508345:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508350:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed3e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508361:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508372:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508379:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508384:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390120.508387:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508392:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508399:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf520a1d700) 00010000:00010000:3.0:1785390120.508402:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390120.508404:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508410:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed3f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508448:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed3e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508461:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.508469:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390120.508471:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390120.508479:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5e00, rc 0) 00000100:00100000:3.0:1785390120.508570:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10522:x1872116847793280:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 754us (947us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1785390120.508577:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:3.0:1785390120.532217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.532363:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847793408 00000100:00100000:1.0:1785390120.532384:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847793408 00000100:00100000:1.0:1785390120.532443:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:1.0:1785390120.532453:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10522:x1872116847793408:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1785390120.532565:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532583:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532596:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532623:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532630:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532637:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532643:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390120.532648:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532656:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532668:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.532670:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390120.532675:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.532692:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.532768:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10522:x1872116847793408:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 316us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.532776:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1785390120.535603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.535679:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847793664 00000100:00100000:1.0:1785390120.535687:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847793664 00000100:00100000:1.0:1785390120.535733:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:1.0:1785390120.535741:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:10522:x1872116847793664:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390120.535954:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10522:x1872116847793664:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 213us (358us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1785390120.535962:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1785390120.636591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390120.636723:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847793920 00000100:00100000:3.0:1785390120.636734:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847793920 00000100:00100000:3.0:1785390120.636795:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:3.0:1785390120.636806:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10532:x1872116847793920:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390120.636836:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390120.636839:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785390120.636865:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c090 expref: 51 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.636884:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390120.636888:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390120.636902:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed40c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0b3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.637019:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.637032:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.637042:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.637075:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.637102:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 51 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390120.637130:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879275776:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390120.637218:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1785390120.645174:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879275776:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390120.645205:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390120.649657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.649848:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847794048 00000100:00100000:1.0:1785390120.649858:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847794048 00010000:00010000:1.0:1785390120.649905:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 52 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.649961:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:1.0:1785390120.649970:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:2360:x1872116847794048:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390120.649985:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390120.649992:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 52 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.650005:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 52 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.650045:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed3f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ac expref: 52 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.650060:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.650065:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.650074:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.650082:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.650109:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390120.650163:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:2360:x1872116847794048:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 192us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.650170:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00010000:00010000:3.0:1785390120.651234:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.651248:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390120.651272:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1785390120.651449:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed40c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.651467:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.651476:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390120.651478:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785390120.651481:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785390120.651585:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10532:x1872116847793920:12345-192.168.202.54@tcp:101:bash.0 Request processed in 14781us (15004us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1785390120.651606:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:2.0:1785390120.660441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.660514:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847794304 00000100:00100000:1.0:1785390120.660557:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847794304 00000100:00100000:1.0:1785390120.660605:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 105 00000100:00100000:1.0:1785390120.660615:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:10532:x1872116847794304:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:1.0:1785390120.660852:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.660865:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.660874:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390120.660944:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1785390120.660975:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000034d72d31 reply state 0000000016ebadaa transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.660984:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390120.661272:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10532:x1872116847794304:12345-192.168.202.54@tcp:36:bash.0 Request processed in 494us (674us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1785390120.661280:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 105 00000020:00080000:1.0:1785390120.661285:0:5803:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785390120.664280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:1.0:1785390120.664563:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.664577:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.664585:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.664592:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390120.664597:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.664606:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.664623:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.664626:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390120.664631:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.664638:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390120.664839:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847794432 00000100:00100000:3.0:1785390120.664849:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847794432 00000100:00100000:3.0:1785390120.664900:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1785390120.664911:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10532:x1872116847794432:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390120.664951:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390120.664967:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0ba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.665042:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.665055:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.665063:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.665095:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.665120:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 54 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390120.665133:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879275904:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390120.665213:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390120.668114:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879275904:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390120.668157:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390120.670405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.670683:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847794560 00000100:00100000:1.0:1785390120.670693:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847794560 00010000:00010000:1.0:1785390120.670734:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 55 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.670775:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1785390120.670785:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:2358:x1872116847794560:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390120.670798:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390120.670805:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 55 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.670817:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 55 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.670838:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0b3 expref: 55 pid: 5804 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.670853:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.670859:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.670868:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.670876:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.670898:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390120.670987:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:2358:x1872116847794560:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 202us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.670995:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00010000:00010000:0.0:1785390120.671503:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.671512:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390120.671585:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1785390120.671590:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390120.671609:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.671640:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.671654:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 53 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.671663:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390120.671666:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390120.671681:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4e00, rc 0) 00000100:00100000:0.0:1785390120.671724:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10532:x1872116847794432:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6815us (7450us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.671732:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:0.0:1785390120.677628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.677727:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847794816 00000100:00100000:1.0:1785390120.677737:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847794816 00000100:00100000:1.0:1785390120.677793:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1785390120.677803:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:10532:x1872116847794816:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:1.0:1785390120.678195:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10532:x1872116847794816:12345-192.168.202.54@tcp:35:bash.0 Request processed in 392us (571us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1785390120.678204:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1785390120.729855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.729957:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847794944 00000100:00100000:0.0:1785390120.729967:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847794944 00000100:00100000:0.0:1785390120.730027:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:0.0:1785390120.730037:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:10538:x1872116847794944:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390120.730076:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390120.730098:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0c1 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.730282:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed43d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.730297:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.730307:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390120.730366:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1785390120.730371:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390120.730393:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.730423:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0c1 expref: 56 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.730442:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0c1 expref: 55 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.730451:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390120.730454:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390120.730457:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717e00, rc 0) 00000100:00100000:0.0:1785390120.730567:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847794944:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 488us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.730575:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:2.0:1785390120.735180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.735265:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847795072 00000100:00100000:0.0:1785390120.735274:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847795072 00000100:00100000:0.0:1785390120.735328:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:0.0:1785390120.735337:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847795072:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390120.735365:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390120.735385:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0c8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735446:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735459:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735470:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735483:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735490:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735495:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735604:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735613:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735635:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390120.735667:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1785390120.735671:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390120.735686:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735696:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735704:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735711:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735717:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735723:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390120.735727:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735734:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735745:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390120.735748:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390120.735752:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735767:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed44b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735779:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735785:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735790:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735796:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390120.735799:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735805:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735812:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50896c700) 00010000:00010000:0.0:1785390120.735814:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390120.735817:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735823:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735850:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0c8 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735863:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0c8 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.735877:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390120.735879:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390120.735882:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:0.0:1785390120.735955:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10538:x1872116847795072:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 618us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.735962:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:2.0:1785390120.738220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.738326:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847795200 00000100:00100000:1.0:1785390120.738332:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847795200 00000100:00100000:1.0:1785390120.738384:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1785390120.738394:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:2359:x1872116847795200:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390120.738405:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390120.738422:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed459 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0c8 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.738434:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.738437:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390120.738471:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:2359:x1872116847795200:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.738478:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1785390120.739095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.739584:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847795456 00000100:00100000:1.0:1785390120.739590:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847795456 00000100:00100000:1.0:1785390120.739621:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:1.0:1785390120.739628:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847795456:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390120.739653:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390120.739668:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0cf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.739820:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.739834:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.739843:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.739873:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.739886:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 56 pid: 5802 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.739899:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e016a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879276032:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390120.740072:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019780 going to sleep for 11 seconds 00000100:00100000:2.0:1785390120.743283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.743358:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847795584 00000100:00100000:0.0:1785390120.743367:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847795584 00010000:00010000:0.0:1785390120.743401:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 57 pid: 5802 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390120.743441:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:0.0:1785390120.743451:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e069850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:2360:x1872116847795584:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390120.743464:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390120.743470:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 57 pid: 5802 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.743483:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 57 pid: 5802 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.743504:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390120.743508:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.743517:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.743566:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.743583:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390120.743618:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e069850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:2360:x1872116847795584:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.743625:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00010000:00010000:1.0:1785390120.744342:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed42f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0ba expref: 56 pid: 5802 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390120.744360:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e016a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879276032:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390120.744389:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.744409:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.744415:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390120.744432:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1785390120.744602:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.744620:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.744628:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.744631:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785390120.744634:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4c00, rc 0) 00000100:00100000:1.0:1785390120.744670:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10538:x1872116847795456:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 5042us (5576us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1785390120.745202:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:2.0:1785390120.751297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390120.751384:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847795840 00000100:00100000:1.0:1785390120.751393:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847795840 00000100:00100000:1.0:1785390120.751451:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1785390120.751460:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10538:x1872116847795840:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:1.0:1785390120.751474:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390120.751495:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed3c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0a5 expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390120.751554:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390120.751559:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390120.751600:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847795840:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 141us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.751606:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1785390120.755983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390120.756045:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847795968 00000100:00100000:3.0:1785390120.756053:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847795968 00000100:00100000:3.0:1785390120.756099:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:3.0:1785390120.756105:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847795968:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:3.0:1785390120.756214:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.756227:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390120.756237:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785390120.756404:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1785390120.756473:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847795968:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 368us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390120.756479:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:2.0:1785390120.758583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390120.758665:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847796096 00000100:00100000:0.0:1785390120.758683:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847796096 00000100:00100000:0.0:1785390120.758737:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1785390120.758747:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:10538:x1872116847796096:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390120.758764:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390120.758785:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0d6 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.758836:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.758848:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 56 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.758866:0:7121:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.758879:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 56 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.758892:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390120.758905:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785390120.758910:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 56 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390120.758929:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717c00, rc 0) 00000100:00100000:0.0:1785390120.758991:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10538:x1872116847796096:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 245us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.758997:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1785390120.982180:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785390120.982299:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879276288:0@lo:400:kworker.0 00000100:00100000:1.0:1785390120.982368:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390120.982428:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390120.982434:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879276416:0@lo:400:kworker.0 00000100:00100000:1.0:1785390120.982459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390120.982509:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879276288 00000100:00100000:1.0:1785390120.982516:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879276288 00000100:00100000:1.0:1785390120.982581:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879276416 00000100:00100000:1.0:1785390120.982585:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879276416 00000100:00080000:1.0:1785390120.982603:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390120.982625:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1785390120.982633:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879276288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390120.982703:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879276288:12345-0@lo:400:kworker.0 Request processed in 70us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.982710:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1785390120.982747:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879276288:0@lo:400:kworker.0 00000100:00100000:1.0:1785390120.982766:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1785390120.982773:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879276416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390120.982806:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879276416:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.982826:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1785390120.982850:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879276416:0@lo:400:kworker.0 00000100:00100000:3.0:1785390120.984110:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390120.984124:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879276544:0@lo:400:kworker.0 00000100:00100000:3.0:1785390120.984164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390120.984286:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879276544 00000100:00100000:1.0:1785390120.984292:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879276544 00000100:00100000:1.0:1785390120.984368:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1785390120.984376:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879276544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390120.984423:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879276544:12345-0@lo:400:kworker.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390120.984430:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1785390120.984815:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879276160:0@lo:400:kworker.0 00000100:00100000:0.0:1785390120.984852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390120.984890:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879276160 00000100:00100000:0.0:1785390120.984894:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879276160 00000100:00100000:0.0:1785390120.984934:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1785390120.984940:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879276160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390120.984976:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879276160:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.984980:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1785390120.985306:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879276160:0@lo:400:kworker.0 00000100:00100000:0.0:1785390120.985334:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879276544:0@lo:400:kworker.0 00000100:00100000:2.0:1785390120.985479:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390120.985488:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879276800:0@lo:400:kworker.0 00000100:00100000:2.0:1785390120.985517:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390120.985552:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879276672:0@lo:400:kworker.0 00000100:00100000:3.0:1785390120.985665:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879276800 00000100:00100000:3.0:1785390120.985676:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879276800 00000100:00100000:0.0:1785390120.985706:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390120.985714:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785390120.985720:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879276800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1785390120.985737:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785390120.985751:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879276672 00000100:00100000:0.0:1785390120.985754:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879276672 00000100:00100000:3.0:1785390120.985756:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879276800:12345-0@lo:400:kworker.0 Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00080000:0.0:1785390120.985768:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390120.985776:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1785390120.985797:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1785390120.985801:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879276800:0@lo:400:kworker.0 00000100:00100000:0.0:1785390120.985802:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879276672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390120.985835:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879276672:12345-0@lo:400:kworker.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390120.985841:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1785390120.985862:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879276672:0@lo:400:kworker.0 00000040:00080000:1.0:1785390121.173764:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785390121.173772:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785390121.173832:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1785390121.173837:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785390121.173965:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879276928:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1785390121.174125:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a019780 going to sleep for 11 seconds 00000100:00100000:1.0:1785390121.181889:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50de83b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879276928:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785390121.189334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.189607:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847796224 00000100:00100000:0.0:1785390121.189617:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847796224 00000100:00100000:0.0:1785390121.189702:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:0.0:1785390121.189712:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10539:x1872116847796224:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785390121.189742:0:5802:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785390121.189843:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10539:x1872116847796224:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 132us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390121.189851:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00080000:1.0:1785390121.190484:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390121.200366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.201077:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847796352 00000100:00100000:3.0:1785390121.201088:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847796352 00000100:00100000:3.0:1785390121.201150:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:3.0:1785390121.201159:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10539:x1872116847796352:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.201228:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201243:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201255:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201270:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201277:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201284:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201306:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201314:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201333:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390121.201370:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1785390121.201374:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390121.201386:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201396:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201402:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201409:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201414:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390121.201418:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201426:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201436:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:3.0:1785390121.201439:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390121.201443:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201449:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed483 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201470:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201476:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201481:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201486:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390121.201489:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201494:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201501:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cf520a1d700) 00010000:00010000:3.0:1785390121.201503:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390121.201506:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201511:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed48a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201563:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201570:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201576:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201969:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390121.201973:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201979:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201987:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390121.201989:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390121.201992:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.201997:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390121.203977:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10539:x1872116847796352:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 2811us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.203987:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:0.0:1785390121.220192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.220321:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847796608 00000100:00100000:3.0:1785390121.220333:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847796608 00000100:00100000:3.0:1785390121.220394:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:3.0:1785390121.220403:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:10539:x1872116847796608:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.220424:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390121.220444:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed498 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0dd expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220570:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220597:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220609:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390121.220636:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1785390121.220753:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220761:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220767:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220773:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390121.220776:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220784:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220796:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390121.220798:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785390121.220811:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220817:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed49f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220853:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed498 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0dd expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220863:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:3.0:1785390121.220865:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390121.220877:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed498 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0dd expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.220887:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4e00, rc 0) 00000100:00100000:3.0:1785390121.221270:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:10539:x1872116847796608:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 867us (1085us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1785390121.221278:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:2.0:1785390121.226627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.227207:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847796736 00000100:00100000:0.0:1785390121.227216:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847796736 00000100:00100000:0.0:1785390121.227273:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:0.0:1785390121.227282:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:10539:x1872116847796736:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785390121.227319:0:5804:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785390121.227420:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:10539:x1872116847796736:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 139us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390121.227428:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:0.0:1785390121.244249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.244896:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847796992 00000100:00100000:3.0:1785390121.244906:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847796992 00000100:00100000:3.0:1785390121.245147:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:3.0:1785390121.245158:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:10539:x1872116847796992:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.245179:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390121.245182:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1785390121.245209:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed43d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0c1 expref: 57 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.245228:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:3.0:1785390121.245233:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390121.245245:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0e4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785390121.245706:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1785390121.245896:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed4b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.245922:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.245933:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.245995:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0e4 expref: 59 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.248571:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0e4 expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.248584:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf520a1d700) 00010000:00010000:3.0:1785390121.248586:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390121.248590:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5000, rc 0) 00000100:00100000:3.0:1785390121.248665:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:10539:x1872116847796992:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 3508us (4423us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1785390121.248673:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 116 00000100:00100000:1.0:1785390121.275143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.278868:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847797248 00000100:00100000:2.0:1785390121.278883:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847797248 00000100:00100000:2.0:1785390121.278962:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:2.0:1785390121.278971:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:10539:x1872116847797248:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785390121.279824:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390121.279853:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed4b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0e4 expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.279873:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf520a1d700) 00010000:00010000:2.0:1785390121.279885:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390121.279905:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.279929:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.279939:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.279953:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.279959:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.279965:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280164:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280173:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280180:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280186:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390121.280190:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280198:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280206:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390121.280209:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390121.280212:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280218:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed4c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280227:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280232:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280238:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280249:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121da00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390121.280252:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280258:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280266:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xda582423 (ffff8cf50629b000) 00010000:00010000:2.0:1785390121.280268:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390121.280272:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.280277:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ed4c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xda582423 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390121.280356:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:10539:x1872116847797248:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1385us (5221us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785390121.280384:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 117 00000100:00100000:0.0:1785390121.284634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.288853:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847797376 00000100:00100000:2.0:1785390121.288867:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847797376 00000100:00100000:2.0:1785390121.288943:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:2.0:1785390121.288954:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:10539:x1872116847797376:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390121.288973:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390121.288994:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ed4d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0eb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.289245:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.289273:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.289284:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.289367:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ed4d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 59 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.289385:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.289393:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:2.0:1785390121.289395:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785390121.289398:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d400, rc 0) 00000100:00100000:2.0:1785390121.290982:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:10539:x1872116847797376:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 2023us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.290991:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1785390121.311179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390121.311311:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847797632 00000100:00100000:1.0:1785390121.311321:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847797632 00000100:00100000:1.0:1785390121.311380:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:1.0:1785390121.311389:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:10539:x1872116847797632:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785390121.311474:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.311491:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.311517:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785390121.312428:0:7121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1785390121.312443:0:7121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429866918012ns, next at 430866913487ns, rc = 0 00000004:00010000:0.0:1785390121.312569:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df7a8eb4 reply state 00000000085b137e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.312580:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785390121.312685:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:10539:x1872116847797632:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1295us (1688us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1785390121.312702:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00010000:00010000:3.0:1785390121.326090:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.326119:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.326128:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.326133:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390121.326139:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.326146:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.326162:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:3.0:1785390121.326178:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785390121.326183:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.326189:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed4de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.338665:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.338962:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847797760 00000100:00100000:3.0:1785390121.338972:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847797760 00000100:00100000:3.0:1785390121.339029:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:3.0:1785390121.339038:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:10539:x1872116847797760:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.339068:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390121.339088:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0f2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.339157:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 60 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.339172:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 60 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.339190:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:3.0:1785390121.339194:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390121.339198:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4e00, rc 0) 00000100:00100000:3.0:1785390121.339256:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:10539:x1872116847797760:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 218us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390121.339263:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 120 00000100:00100000:0.0:1785390121.354750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.354946:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847797888 00000100:00100000:3.0:1785390121.354957:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847797888 00000100:00100000:3.0:1785390121.355046:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1785390121.355057:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847797888:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1785390121.355350:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2359:x1872116847797888:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 295us (610us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785390121.355359:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00080000:1.0:1785390121.355558:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785390121.371980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.372061:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847798144 00000100:00100000:3.0:1785390121.372071:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847798144 00000100:00100000:3.0:1785390121.372133:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:3.0:1785390121.372144:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:10539:x1872116847798144:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785390121.372372:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:10539:x1872116847798144:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 228us (400us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1785390121.372381:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1785390121.379139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.384257:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847798400 00000100:00100000:2.0:1785390121.384272:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847798400 00000100:00100000:2.0:1785390121.384334:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:2.0:1785390121.384344:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:10539:x1872116847798400:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785390121.384933:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:10539:x1872116847798400:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 589us (5802us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.384943:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 121 00000100:00100000:0.0:1785390121.397971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.398249:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847798528 00000100:00100000:3.0:1785390121.398258:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847798528 00000100:00100000:3.0:1785390121.398344:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:3.0:1785390121.398353:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:10539:x1872116847798528:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.398372:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390121.398392:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed4ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c0f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.398454:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed4f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.398468:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.398479:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390121.398565:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390121.398583:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.398606:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed4ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f9 expref: 63 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.398621:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f9 expref: 62 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.398629:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:3.0:1785390121.398632:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1785390121.398634:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4800, rc 0) 00000100:00100000:3.0:1785390121.398690:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:10539:x1872116847798528:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 338us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390121.398717:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:0.0:1785390121.411966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390121.412196:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847798656 00000100:00100000:1.0:1785390121.412205:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847798656 00000100:00100000:1.0:1785390121.412259:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:1.0:1785390121.412268:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2360:x1872116847798656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390121.412287:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390121.412307:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c100 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785390121.412335:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6ae429, blocks: 0x1 00010000:00010000:1.0:1785390121.412353:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:1.0:1785390121.412357:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390121.412366:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 10 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.412384:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 10 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.412398:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785390121.412453:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2360:x1872116847798656:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 185us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390121.412461:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:0.0:1785390121.425380:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.425475:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847798912 00000100:00100000:2.0:1785390121.425496:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847798912 00000100:00100000:2.0:1785390121.425577:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1785390121.425587:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:10539:x1872116847798912:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1785390121.425703:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:10539:x1872116847798912:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 110us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.425711:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00010000:00010000:2.0:1785390121.429994:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390121.445777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.445928:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799040 00000100:00100000:3.0:1785390121.445938:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799040 00000100:00100000:3.0:1785390121.445990:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1785390121.445997:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:10539:x1872116847799040:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.446016:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390121.446034:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c107 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.446067:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.446092:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390121.446096:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390121.446112:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.446147:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.446160:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390121.446173:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879277056:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390121.446265:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1785390121.452995:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.455248:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879277056:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390121.455288:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.455310:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:2.0:1785390121.455380:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+11:10539:x1872116847799040:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 9382us (9612us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.455390:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1785390121.455794:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799168 00000100:00100000:0.0:1785390121.455812:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799168 00010000:00010000:0.0:1785390121.455846:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.455877:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1785390121.455885:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+11:2359:x1872116847799168:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390121.455899:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390121.455932:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.455966:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.455988:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa39a39/0x33dffe75ff5ed4fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c100 expref: 11 pid: 7936 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.456002:0:11040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785390121.456006:0:11040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390121.456013:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.456023:0:11040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.456053:0:11040:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.456068:0:11040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11040:1872116879277184:192.168.202.54@tcp:105: 00000100:00100000:0.0:1785390121.456125:0:11040:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785390121.466083:0:11040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11040:1872116879277184:192.168.202.54@tcp:105: 00010000:00010000:1.0:1785390121.466130:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390121.466182:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2359:x1872116847799168:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 10297us (13195us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390121.466192:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:1.0:1785390121.475129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.475224:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799296 00000100:00100000:0.0:1785390121.475232:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799296 00002000:00100000:0.0:1785390121.475278:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cf535831880 x1872116847799296/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:107/0 lens 504/0 e 0 to 0 dl 1785390132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785390121.475288:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf535831880 with x1872116847799296 ext(0->12) 00002000:00010000:0.0:1785390121.475303:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf535831880 00000100:00100000:0.0:1785390121.475335:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1785390121.475343:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2357:x1872116847799296:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1785390121.475959:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:2357:x1872116847799296:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 460us (682us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1785390121.475969:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00002000:00100000:0.0:1785390121.475977:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cf535831880 x1872116847799296/t4294967308(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:107/0 lens 504/448 e 0 to 0 dl 1785390132 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1785390121.475986:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf535831880 with x1872116847799296 ext(0->12) 00002000:00010000:0.0:1785390121.475990:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf535831880 00000100:00100000:3.0:1785390121.479261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.479345:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799424 00000100:00100000:2.0:1785390121.479354:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799424 00000100:00100000:2.0:1785390121.479399:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:2.0:1785390121.479408:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:10539:x1872116847799424:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1785390121.501821:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879277312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390121.501886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390121.503893:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879277312 00000100:00100000:2.0:1785390121.503915:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879277312 00000100:00100000:2.0:1785390121.503967:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785390121.503977:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879277312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390121.504006:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390121.504074:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879277312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.504093:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1785390121.504158:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879277312:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1785390121.610077:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967379 is committed 00000020:00080000:2.0:1785390121.610111:0:5824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1785390121.610122:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1785390121.610126:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1785390121.610153:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1785390121.610168:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf50a019900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1785390121.610172:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf541deaa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf50a019a80 00000020:00080000:2.0:1785390121.610176:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf541dea900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf5354c0c00 00000004:00080000:2.0:1785390121.610198:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1785390121.610230:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf5354e9c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1785390121.610233:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf541403700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf5354e9e40 00000020:00080000:2.0:1785390121.610237:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf541403200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf535781400 00000001:00080000:2.0:1785390121.610246:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:2.0:1785390121.610427:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1785390121.610445:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879277696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785390121.610505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390121.610776:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:10539:x1872116847799424:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 131365us (131519us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390121.610785:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 124 00000100:00100000:1.0:1785390121.612213:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879277696 00000100:00100000:1.0:1785390121.612224:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879277696 00000100:00100000:1.0:1785390121.612280:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785390121.612290:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879277696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785390121.612318:0:7936:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1785390121.612352:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a6ae427, atime: 0x6a6ae428, ctime: 0x6a6ae427, blocks: 0x1 00010000:00010000:1.0:1785390121.612360:0:7936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.612377:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1785390121.612381:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390121.612389:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.612404:0:7936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.612414:0:7936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.612422:0:7936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1785390121.612577:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1785390121.612793:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1785390121.613268:0:7936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785390121.613924:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1872116879277696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1633us (3416us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1785390121.613935:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1785390121.614005:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf50e12f800/2, rc 0, transno 4294967304 00000100:00100000:1.0:1785390121.614012:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879277696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1785390121.615119:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879277440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785390121.615161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390121.615198:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785390121.615203:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879277568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1785390121.615220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390121.615252:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879277440 00000100:00100000:0.0:1785390121.615258:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879277440 00000100:00100000:0.0:1785390121.615287:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879277568 00000100:00100000:0.0:1785390121.615290:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879277568 00000100:00100000:0.0:1785390121.615305:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1785390121.615312:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1872116879277440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785390121.615335:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1785390121.615354:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.615388:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 11 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.615398:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1785390121.615402:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390121.615407:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.615447:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 11 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.615460:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 11 pid: 7936 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.615472:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879277824:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390121.615537:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390121.615925:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1785390121.615935:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1872116879277568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1785390121.616056:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785390121.616060:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785390121 00002000:00010000:2.0:1785390121.616062:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785390121.616065:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1785390121 -> 1785390121 00002000:00010000:2.0:1785390121.616072:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785390121.616122:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1872116879277568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 190us (900us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1785390121.616136:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1785390121.619003:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf50e12d500/2, rc 0, transno 4294967309 00000100:00100000:0.0:1785390121.619016:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879277568:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1785390121.625266:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390121.625281:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.625318:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390121.625323:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.625333:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.625358:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.625365:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000550319b0/0x33dffe75ff5ed508 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.626074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390121.626224:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799552 00000100:00100000:1.0:1785390121.626233:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799552 00000100:00100000:1.0:1785390121.626284:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:1.0:1785390121.626295:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:2357:x1872116847799552:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1785390121.626421:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390121.626424:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390121.626426:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390121.627107:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879277824:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390121.627130:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390121.637163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.637390:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799680 00000100:00100000:0.0:1785390121.637400:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799680 00010000:00010000:0.0:1785390121.637438:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 13 pid: 7936 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.637478:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:0.0:1785390121.637500:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:2359:x1872116847799680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390121.637514:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390121.637520:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 13 pid: 7936 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637563:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 13 pid: 7936 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637586:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001330bb2d/0x33dffe75ff5ed2ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c066 expref: 13 pid: 7936 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637602:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390121.637606:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390121.637612:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637622:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637650:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390121.637710:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:2359:x1872116847799680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 211us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390121.637718:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00010000:00010000:0.0:1785390121.637741:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637760:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637769:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637777:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.637792:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1785390121.638394:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1872116879277440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23080us (23231us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1785390121.638402:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1785390121.638423:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390121.638429:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.638437:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390121.638441:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.638451:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.638462:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.638477:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc54115a/0x33dffe75ff5ed50f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.638492:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390121.638494:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390121.638496:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1785390121.638550:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf50e12ca80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1785390121.638557:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879277440:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1785390121.834189:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1785390121.834213:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1785390121.834221:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1785390121.834645:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847799552:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 208346us (208569us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390121.834657:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1785390121.837923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.838288:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847799936 00000100:00100000:2.0:1785390121.838299:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847799936 00000100:00100000:2.0:1785390121.838362:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:2.0:1785390121.838372:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:10539:x1872116847799936:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785390121.838423:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390121.838449:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed4f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f9 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.838470:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:2.0:1785390121.838475:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390121.838502:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.838516:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390121.838768:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390121.839351:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000391c3a40 reply state 000000005f4ee9b6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390121.839373:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390121.839505:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:10539:x1872116847799936:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1133us (1589us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1785390121.839512:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:0.0:1785390121.855189:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390121.857712:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847800064 00000100:00100000:2.0:1785390121.857728:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847800064 00000100:00100000:2.0:1785390121.857785:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1785390121.857807:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847800064:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785390121.858035:0:7936:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1785390121.858039:0:7936:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1785390121 -> 1785390120 00002000:00010000:2.0:1785390121.858041:0:7936:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1785390120 00002000:00010000:2.0:1785390121.858043:0:7936:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1785390121 -> 1785390120 00002000:00010000:2.0:1785390121.858046:0:7936:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1785390121.858107:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847800064:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 313us (2927us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1785390121.858115:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1785390121.864746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.864919:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847800320 00000100:00100000:3.0:1785390121.864928:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847800320 00000100:00100000:3.0:1785390121.864988:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:3.0:1785390121.864997:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:10539:x1872116847800320:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1785390121.865068:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.865111:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.865122:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.865155:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.865169:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390121.865184:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879277952:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390121.865270:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535859840 going to sleep for 11 seconds 00000100:00100000:0.0:1785390121.869176:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879277952:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390121.869202:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869577:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869586:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869593:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869597:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390121.869601:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869608:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869643:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:1.0:1785390121.869646:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390121.869650:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.869656:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed516 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.879175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390121.879511:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847800448 00000100:00100000:3.0:1785390121.879521:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847800448 00010000:00010000:3.0:1785390121.879596:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390121.879646:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1785390121.879656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:2360:x1872116847800448:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390121.879681:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390121.879690:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.879702:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.879738:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed4d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0eb expref: 16 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.879755:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:3.0:1785390121.879759:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.879770:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.879778:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390121.880211:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390121.880283:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880291:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880322:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880328:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880333:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880348:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390121.880353:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880361:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880372:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:0.0:1785390121.880375:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1785390121.880379:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.880386:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed51d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.880463:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:10539:x1872116847800320:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 15467us (15726us total) trans 0 rc -22/-22 00000100:00100000:0.0:1785390121.880472:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:2.0:1785390121.880569:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2360:x1872116847800448:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 912us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390121.880578:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1785390121.916417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.916717:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847800576 00000100:00100000:0.0:1785390121.916728:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847800576 00000100:00100000:0.0:1785390121.916785:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:0.0:1785390121.916794:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847800576:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1785390121.916846:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.916867:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.916893:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390121.916897:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390121.916912:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.916949:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.916962:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 7 pid: 6599 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.916977:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879278080:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390121.917059:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15900 going to sleep for 11 seconds 00000100:00100000:0.0:1785390121.935400:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879278080:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390121.935428:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390121.945399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.945758:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847800704 00000100:00100000:0.0:1785390121.945767:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847800704 00010000:00010000:0.0:1785390121.945814:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 8 pid: 6599 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.945850:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:0.0:1785390121.945859:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847800704:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390121.945885:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390121.945934:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 8 pid: 6599 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.945948:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 8 pid: 6599 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.945970:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f575fe5/0x33dffe75ff5ed501 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c107 expref: 8 pid: 6599 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.945986:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390121.945990:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390121.945996:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.946006:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.946042:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390121.946090:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847800704:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 232us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390121.946105:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00010000:00010000:1.0:1785390121.946224:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946234:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946262:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946271:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946280:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946287:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390121.946291:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946314:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946326:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.946335:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3345b4a/0x33dffe75ff5ed524 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390121.946379:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847800576:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 29586us (29972us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390121.946387:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:3.0:1785390121.976765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390121.976916:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847800960 00000100:00100000:0.0:1785390121.976925:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847800960 00000100:00100000:0.0:1785390121.976985:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:0.0:1785390121.976995:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10539:x1872116847800960:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1785390121.977086:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977115:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977127:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977320:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977332:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977340:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977369:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.977380:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 15 pid: 5802 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390121.977393:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879278208:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390121.977469:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15900 going to sleep for 11 seconds 00000100:00100000:0.0:1785390121.993279:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879278208:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390121.993307:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390121.996329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390121.996978:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847801088 00000100:00100000:1.0:1785390121.996988:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847801088 00010000:00010000:1.0:1785390121.997025:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 16 pid: 5802 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390121.997066:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:1.0:1785390121.997075:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:2359:x1872116847801088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390121.997090:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390121.997202:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 16 pid: 5802 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.997217:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 16 pid: 5802 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.997258:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed4e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0f2 expref: 16 pid: 5802 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.997275:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:1.0:1785390121.997281:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.997290:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.997298:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390121.997328:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390121.997377:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:2359:x1872116847801088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 302us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390121.997384:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00010000:00010000:0.0:1785390121.999191:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390121.999204:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785390121.999383:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1785390121.999517:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1785390122.001193:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1785390122.001287:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879278336:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1785390122.001366:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390122.001404:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50894bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390122.003028:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879278336 00000100:00100000:3.0:1785390122.003039:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879278336 00000100:00100000:3.0:1785390122.003113:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785390122.003132:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1872116879278336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785390122.003954:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1872116879278336:12345-0@lo:1000:mdt00_002.0 Request processed in 823us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390122.003963:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1785390122.005727:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390122.015847:0:5804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1785390122.015858:0:5804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1785390122.015876:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf50e12d500, transno 4294967309 00000100:00100000:2.0:1785390122.015910:0:5804:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf50e12ca80 x1872116879277440/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785390137 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390122.015923:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879278336:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1785390122.016411:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1785390122.016483:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879278464:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785390122.016581:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390122.016610:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15900 going to sleep for 11 seconds 00000100:00100000:1.0:1785390122.018153:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879278464 00000100:00100000:1.0:1785390122.018163:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879278464 00000100:00100000:1.0:1785390122.018218:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785390122.018237:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1872116879278464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785390122.018440:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5804:x1872116879278464:12345-0@lo:1000:mdt00_002.0 Request processed in 214us (1858us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1785390122.018447:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785390122.024181:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879278464:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1785390122.024231:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024242:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024250:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024256:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390122.024260:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024267:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024280:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf50629b900) 00010000:00010000:2.0:1785390122.024283:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785390122.024287:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024292:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed532 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024319:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024336:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024341:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024345:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390122.024347:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024352:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024358:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:2.0:1785390122.024360:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785390122.024366:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024376:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024383:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.024416:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390122.024428:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879278592:192.168.202.54@tcp:105: 00000100:00100000:2.0:1785390122.024508:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf540f15900 going to sleep for 11 seconds 00000100:00100000:3.0:1785390122.035470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390122.035491:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879278720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390122.035599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390122.035941:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879278720 00000100:00100000:2.0:1785390122.035949:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879278720 00000100:00100000:2.0:1785390122.035995:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1785390122.036004:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879278720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390122.036036:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:1.0:1785390122.036290:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390122.045332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390122.045562:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847801216 00000100:00100000:1.0:1785390122.045571:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847801216 00000100:00100000:1.0:1785390122.045646:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:1.0:1785390122.045656:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:10538:x1872116847801216:12345-192.168.202.54@tcp:49:lfs.0 00000100:00100000:1.0:1785390122.045788:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:10538:x1872116847801216:12345-192.168.202.54@tcp:49:lfs.0 Request processed in 132us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390122.045807:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:3.0:1785390122.050672:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879278592:192.168.202.54@tcp:105: 00010000:00010000:3.0:1785390122.050702:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050713:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed475 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050750:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050764:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050775:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050785:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050800:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050807:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050813:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390122.050818:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050825:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050855:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390122.050858:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390122.050861:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050867:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed539 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050877:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050883:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050889:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050893:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390122.050895:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050912:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050920:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390122.050922:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785390122.050925:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.050931:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed52b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390122.051181:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10539:x1872116847800960:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 74186us (74422us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1785390122.051191:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000020:00080000:3.0:1785390122.051197:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1785390122.051272:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879278720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15268us (15671us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390122.051280:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000040:00080000:1.0:1785390122.051643:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785390122.051648:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785390122.051671:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1785390122.051676:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1785390122.052163:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879278720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390122.065031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390122.065125:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847801472 00000100:00100000:2.0:1785390122.065135:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847801472 00000100:00100000:2.0:1785390122.065193:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:2.0:1785390122.065202:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10538:x1872116847801472:12345-192.168.202.54@tcp:58:lfs.0 00000040:00080000:2.0:1785390122.065720:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1785390122.065863:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10538:x1872116847801472:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 594us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390122.065871:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 128 00000100:00100000:2.0:1785390122.071982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390122.072760:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847801728 00000100:00100000:1.0:1785390122.072770:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847801728 00000100:00100000:1.0:1785390122.072876:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1785390122.072886:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5087cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:10539:x1872116847801728:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1785390122.073518:0:5806:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1785390122.076115:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1785390122.076186:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390122.076205:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390122.076218:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390122.076228:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390122.076235:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390122.076251:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390122.076276:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1785390122.076388:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5087cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10539:x1872116847801728:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 3500us (4411us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1785390122.076397:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000020:00080000:1.0:1785390122.076403:0:5806:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785390122.078287:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390122.078300:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.078309:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390122.078313:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.078330:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.078344:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf510c5a800) 00010000:00010000:2.0:1785390122.078347:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785390122.078361:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.078366:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed540 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.078384:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390122.078385:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390122.078387:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390122.141482:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390122.144655:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847801856 00000100:00100000:2.0:1785390122.144669:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847801856 00000100:00100000:2.0:1785390122.144747:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 129 00000100:00100000:2.0:1785390122.144757:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:10542:x1872116847801856:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390122.144782:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390122.144813:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c10e expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.144871:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.144884:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.144896:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.144924:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.144931:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.144957:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.145209:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.145221:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.145230:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.145263:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.145276:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 21 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390122.145291:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879278848:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390122.145393:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50894bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390122.152482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390122.154748:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847802112 00000100:00100000:0.0:1785390122.154760:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847802112 00000100:00100000:0.0:1785390122.154836:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1785390122.154848:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:5580:x1872116847802112:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785390122.155109:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:5580:x1872116847802112:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 264us (2637us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1785390122.155117:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1785390122.156705:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879278848:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390122.156729:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390122.158082:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390122.158260:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847802240 00000100:00100000:3.0:1785390122.158268:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847802240 00010000:00010000:3.0:1785390122.158300:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 23 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390122.158335:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:3.0:1785390122.158343:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e069050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:2360:x1872116847802240:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390122.158355:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390122.158361:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 23 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.158372:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 23 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.158393:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed467 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0cf expref: 23 pid: 5803 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.158425:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:3.0:1785390122.158429:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.158438:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.158446:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390122.158473:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390122.158514:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e069050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:2360:x1872116847802240:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 172us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390122.158565:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00010000:00010000:2.0:1785390122.158736:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158754:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390122.158805:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1785390122.158809:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390122.158825:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158837:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158847:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158853:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158859:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158865:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390122.158869:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158876:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158884:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390122.158887:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390122.158891:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158916:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed54e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158928:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158934:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158939:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158943:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390122.158946:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158951:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158958:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf50629b000) 00010000:00010000:2.0:1785390122.158960:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390122.158963:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158968:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.158998:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c10e expref: 22 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.159011:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c10e expref: 21 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390122.159037:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:2.0:1785390122.159040:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390122.159042:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121dc00, rc 0) 00000100:00100000:2.0:1785390122.159067:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:10542:x1872116847801856:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 14312us (17594us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390122.159074:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 129 00010000:00010000:3.0:1785390122.454794:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785390122.616879:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1785390122.616909:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1785390122.616920:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:2.0:1785390123.102150:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785390123.102163:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390123.102210:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1785390123.102231:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785390123.102406:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879278976:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785390123.102880:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0540 going to sleep for 11 seconds 00000100:00100000:2.0:1785390123.107645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.107713:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847802368 00000100:00100000:2.0:1785390123.107724:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847802368 00000100:00100000:2.0:1785390123.107834:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:2.0:1785390123.107848:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10553:x1872116847802368:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1785390123.107921:0:5803:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1785390123.108097:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10553:x1872116847802368:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 242us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390123.108107:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000040:00080000:3.0:1785390123.108603:0:11979:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785390123.108609:0:11979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785390123.108667:0:11979:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1785390123.108673:0:11979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:2.0:1785390123.111395:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390123.122376:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879278976:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785390123.127984:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390123.128759:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847802624 00000100:00100000:0.0:1785390123.128781:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847802624 00000100:00100000:0.0:1785390123.128864:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:0.0:1785390123.128874:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:10553:x1872116847802624:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390123.128910:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390123.128942:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed563 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c115 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390123.129081:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed56a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390123.129295:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390123.129309:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390123.129383:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1785390123.129771:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed563 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c115 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390123.130173:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed56a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c115 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390123.130183:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390123.130186:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390123.130191:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717000, rc 0) 00000100:00100000:0.0:1785390123.130442:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:10553:x1872116847802624:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1566us (2464us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1785390123.130452:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:2.0:1785390123.151783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.152432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.152495:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847802752 00000100:00100000:2.0:1785390123.152507:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847802752 00000100:00100000:2.0:1785390123.152612:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1785390123.152625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:2360:x1872116847802752:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390123.152644:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390123.152686:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed56a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c115 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.152710:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:2.0:1785390123.152717:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390123.152908:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:2360:x1872116847802752:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 285us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390123.152916:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1785390123.153018:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803008 00000100:00100000:2.0:1785390123.153022:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803008 00000100:00100000:2.0:1785390123.153049:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 132 00000100:00100000:2.0:1785390123.153055:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:10553:x1872116847803008:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1785390123.153144:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.153162:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.153173:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.158693:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.158738:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.158748:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.158754:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390123.158760:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.158769:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.163309:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:2.0:1785390123.163315:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1785390123.163438:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390123.163449:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390123.163768:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:10553:x1872116847803008:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 10705us (11330us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1785390123.163781:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 132 00000040:00080000:1.0:1785390123.168918:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785390123.168929:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1785390123.171420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390123.171633:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803264 00000100:00100000:0.0:1785390123.171666:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803264 00000100:00100000:0.0:1785390123.171727:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1785390123.171738:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:10553:x1872116847803264:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1785390123.172226:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:10553:x1872116847803264:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 489us (817us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1785390123.172234:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000040:00080000:1.0:1785390123.173141:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1785390123.173155:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785390123.453986:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.454029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.454059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.454087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.454135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390123.455607:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803520 00000100:00100000:2.0:1785390123.455622:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803520 00000100:00100000:2.0:1785390123.455691:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803904 00000100:00100000:2.0:1785390123.455695:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803904 00000100:00100000:2.0:1785390123.455735:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:2.0:1785390123.455747:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:2357:x1872116847803520:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390123.455861:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:2357:x1872116847803520:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 117us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390123.455870:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:2.0:1785390123.455902:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:2.0:1785390123.455909:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847803904:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390123.455939:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2357:x1872116847803904:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390123.455945:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:2.0:1785390123.455972:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803776 00000100:00100000:2.0:1785390123.455976:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803776 00000100:00100000:2.0:1785390123.456009:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803648 00000100:00100000:2.0:1785390123.456013:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803648 00000100:00100000:2.0:1785390123.456035:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1785390123.456042:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847803776:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390123.456073:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847803776:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 32us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390123.456080:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1785390123.456092:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:2.0:1785390123.456098:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847803648:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390123.456141:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847803648:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 43us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390123.456147:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00080000:2.0:1785390123.456179:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390123.456184:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390123.456187:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390123.459085:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847803392 00000100:00100000:3.0:1785390123.459100:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847803392 00010000:00010000:2.0:1785390123.485938:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390123.492902:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 310 00000100:00100000:3.0:1785390123.492927:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847803392:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390123.493188:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847803392:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 270us (39126us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390123.493199:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 310 00010000:00010000:3.0:1785390124.504469:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785390125.187001:0:12030:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390125.187015:0:12030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390125.187078:0:12030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1785390125.187085:0:12030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785390125.389304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390125.389405:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804160 00000100:00100000:0.0:1785390125.389417:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804160 00000100:00100000:0.0:1785390125.389515:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00100000:0.0:1785390125.389556:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:10574:x1872116847804160:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390125.389585:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390125.389614:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed57f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c11c expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.389758:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed586 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.389779:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed586 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.389794:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed586 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390125.389810:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1785390125.390009:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed57f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c11c expref: 27 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.390045:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed586 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c11c expref: 26 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.390068:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390125.390072:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1785390125.390076:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717200, rc 0) 00000100:00100000:0.0:1785390125.390484:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:10574:x1872116847804160:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 957us (1192us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1785390125.390493:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 133 00000100:00080000:1.0:1785390125.391346:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390125.395468:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390125.395709:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804288 00000100:00100000:0.0:1785390125.395722:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804288 00000100:00100000:0.0:1785390125.395789:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:0.0:1785390125.395799:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:10574:x1872116847804288:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:0.0:1785390125.395911:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.395932:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.395956:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.395992:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.396001:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.396031:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.396038:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390125.396044:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.396068:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.396083:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:0.0:1785390125.396086:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785390125.396091:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390125.396098:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390125.396346:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:10574:x1872116847804288:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 547us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390125.396355:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00010000:00010000:2.0:1785390125.525726:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390125.531739:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390125.531842:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804416 00000100:00100000:2.0:1785390125.531853:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804416 00000100:00100000:2.0:1785390125.531983:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1785390125.531993:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847804416:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:2.0:1785390125.532018:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390125.532044:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d129cb/0x33dffe75ff5ed59b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c123 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390125.532092:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a6ae428, atime: 0x6a6ae428, ctime: 0x6a6ae428, blocks: 0xb 00010000:00010000:2.0:1785390125.532117:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1785390125.532130:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390125.532141:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d129cb/0x33dffe75ff5ed59b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c123 expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390125.532161:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078d129cb/0x33dffe75ff5ed59b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c123 expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390125.532176:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121da00, rc 0) 00000100:00100000:2.0:1785390125.532252:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2357:x1872116847804416:12345-192.168.202.54@tcp:101:cat.0 Request processed in 260us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390125.532259:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00080000:3.0:1785390125.535980:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785390125.538452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390125.538498:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804544 00000100:00100000:3.0:1785390125.538510:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804544 00002000:00100000:3.0:1785390125.538596:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8cf53a78ce00 x1872116847804544/t0(0) o3->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:111/0 lens 488/0 e 0 to 0 dl 1785390136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785390125.538609:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53a78ce00 with x1872116847804544 ext(0->4095) 00002000:00010000:3.0:1785390125.538617:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53a78ce00 00000100:00100000:3.0:1785390125.538715:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:3.0:1785390125.538727:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847804544:12345-192.168.202.54@tcp:3:cat.0 00000100:00100000:3.0:1785390125.539381:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847804544:12345-192.168.202.54@tcp:3:cat.0 Request processed in 654us (940us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1785390125.539391:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00002000:00100000:3.0:1785390125.539398:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8cf53a78ce00 x1872116847804544/t0(0) o3->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:111/0 lens 488/4536 e 0 to 0 dl 1785390136 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1785390125.539408:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53a78ce00 with x1872116847804544 ext(0->4095) 00002000:00010000:3.0:1785390125.539412:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53a78ce00 00000100:00100000:0.0:1785390126.105203:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879279232:0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.105310:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390126.105517:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879279104:0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.105575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390126.105628:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279232 00000100:00100000:2.0:1785390126.105637:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279232 00000100:00100000:2.0:1785390126.105713:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1785390126.105725:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879279232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.105786:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879279232:12345-0@lo:400:kworker.0 Request processed in 63us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390126.105794:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1785390126.105826:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879279488:0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.105886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390126.105917:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879279360:0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.105944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390126.105964:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279360 00000100:00100000:2.0:1785390126.105968:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279360 00000100:00100000:2.0:1785390126.105998:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1785390126.106004:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879279360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.106038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879279360:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390126.106044:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1785390126.106061:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279488 00000100:00100000:2.0:1785390126.106064:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279488 00000100:00100000:2.0:1785390126.106198:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785390126.106215:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879279488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.106256:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879279488:12345-0@lo:400:kworker.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390126.106262:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785390126.106303:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279104 00000100:00100000:2.0:1785390126.106307:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279104 00000100:00100000:2.0:1785390126.106333:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1785390126.106339:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879279104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.106575:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879279232:0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.106585:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879279744:0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.106611:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390126.106877:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879279616:0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.106905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390126.106944:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1785390126.106951:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1785390126.106968:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf50e12f800, transno 4294967304 00000100:00100000:0.0:1785390126.106980:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879279488:0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.107250:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879279104:12345-0@lo:400:kworker.0 Request processed in 910us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390126.107258:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1785390126.107315:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879279360:0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.107335:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279616 00000100:00100000:2.0:1785390126.107339:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279616 00000100:00100000:2.0:1785390126.107380:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1785390126.107386:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879279616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.107416:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879279616:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390126.107422:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1785390126.107441:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279744 00000100:00100000:2.0:1785390126.107445:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279744 00000100:00100000:2.0:1785390126.107472:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1785390126.107479:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879279744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390126.107513:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1872116879279744:12345-0@lo:400:kworker.0 Request processed in 35us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390126.107519:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1785390126.107682:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390126.107687:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785390126.107690:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390126.113247:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879279744:0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.113299:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879279104:0@lo:400:kworker.0 00000100:00100000:0.0:1785390126.113314:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879279616:0@lo:400:kworker.0 00010000:00010000:1.0:1785390126.552056:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390126.613871:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390126.613902:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879279872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390126.613995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390126.614152:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879279872 00000100:00100000:1.0:1785390126.614162:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879279872 00000100:00100000:1.0:1785390126.614230:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785390126.614241:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1872116879279872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390126.614290:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390126.614342:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1872116879279872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390126.614350:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1785390126.615639:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879279872:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1785390126.828481:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1785390126.828552:0:5824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1785390126.828589:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf508803cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1785390126.828594:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf50e21d400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf508803480 00000020:00080000:2.0:1785390126.828598:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf50e21dc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf5354c2400 00000020:00080000:0.0:1785390126.828671:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1785390126.828912:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1785390127.126782:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390127.126821:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879280000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390127.126919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390127.129963:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280000 00000100:00100000:1.0:1785390127.129981:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280000 00000100:00100000:1.0:1785390127.130069:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785390127.130081:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879280000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390127.130129:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390127.130223:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879280000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390127.130232:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1785390127.137721:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879280000:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1785390127.232250:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1785390127.232276:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1785390127.232282:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1785390127.573992:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390128.572661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390128.572708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390128.572732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390128.572749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390128.572770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390128.572802:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804928 00000100:00100000:2.0:1785390128.572813:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804928 00000100:00100000:2.0:1785390128.572891:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805056 00000100:00100000:2.0:1785390128.572895:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805056 00000100:00100000:2.0:1785390128.572919:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1785390128.572930:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847804928:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390128.573029:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847804928:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 101us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390128.573047:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1785390128.573067:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:2.0:1785390128.573074:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847805056:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390128.573202:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847805056:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 128us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390128.573209:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 107 00000100:00100000:2.0:1785390128.573229:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805184 00000100:00100000:2.0:1785390128.573232:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805184 00000100:00100000:2.0:1785390128.573274:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804800 00000100:00100000:2.0:1785390128.573277:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804800 00000100:00100000:2.0:1785390128.573295:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:2.0:1785390128.573301:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847805184:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390128.573330:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847805184:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390128.573336:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:2.0:1785390128.573346:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:2.0:1785390128.573352:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:2358:x1872116847804800:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390128.573371:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:2358:x1872116847804800:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 20us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390128.573378:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00080000:2.0:1785390128.573400:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785390128.573405:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390128.573407:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390128.573888:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847804672 00000100:00100000:0.0:1785390128.573894:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847804672 00000100:00100000:0.0:1785390128.573932:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 312 00000100:00100000:0.0:1785390128.573939:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847804672:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390128.574514:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847804672:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 575us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390128.574542:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 312 00010000:00010000:2.0:1785390128.599691:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390129.621724:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390130.645634:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390131.222335:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879280128:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390131.222445:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879280640:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390131.222496:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1785390131.222511:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879280256:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222555:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390131.222573:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879280768:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222607:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390131.222639:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879280384:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390131.222681:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390131.222687:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879280512:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390131.222743:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280128 00000100:00100000:2.0:1785390131.222749:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280128 00000100:00100000:2.0:1785390131.222791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1785390131.222800:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879280128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222860:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879280128:12345-0@lo:400:kworker.0 Request processed in 60us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390131.222868:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1785390131.222901:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280640 00000100:00100000:2.0:1785390131.222904:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280640 00000100:00100000:2.0:1785390131.222932:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280256 00000100:00100000:2.0:1785390131.222935:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280256 00000100:00100000:2.0:1785390131.222944:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280384 00000100:00100000:2.0:1785390131.222947:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280384 00000100:00100000:2.0:1785390131.222961:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1785390131.222967:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879280640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.222998:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879280640:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390131.223004:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1785390131.226895:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1785390131.226918:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879280256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.226993:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879280256:12345-0@lo:400:kworker.0 Request processed in 87us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390131.227013:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1785390131.227033:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1785390131.227041:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879280384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227083:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879280384:12345-0@lo:400:kworker.0 Request processed in 43us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390131.227089:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1785390131.227120:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280768 00000100:00100000:2.0:1785390131.227127:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280768 00000100:00100000:2.0:1785390131.227158:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280512 00000100:00100000:2.0:1785390131.227160:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280512 00000100:00100000:2.0:1785390131.227177:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1785390131.227183:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879280768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227214:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879280768:12345-0@lo:400:kworker.0 Request processed in 31us (4606us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390131.227220:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1785390131.227231:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1785390131.227236:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879280512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227263:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879280512:12345-0@lo:400:kworker.0 Request processed in 26us (4553us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390131.227269:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1785390131.227296:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390131.227300:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390131.227302:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390131.227343:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879280512:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227357:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879280384:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227405:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879280256:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227416:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1785390131.227420:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf50e12ca80, transno 4294967310 00000004:00080000:2.0:1785390131.227433:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1785390131.227446:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879280768:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227457:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879280128:0@lo:400:kworker.0 00000100:00100000:2.0:1785390131.227467:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879280640:0@lo:400:kworker.0 00010000:00010000:2.0:1785390131.669907:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390131.733741:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785390131.733765:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879280896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390131.733850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390131.733948:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879280896 00000100:00100000:1.0:1785390131.733956:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879280896 00000100:00100000:1.0:1785390131.734007:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1785390131.734016:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879280896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390131.734050:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390131.734105:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879280896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390131.734112:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1785390131.735678:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879280896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390131.747136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390131.747382:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805312 00000100:00100000:1.0:1785390131.747392:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805312 00000100:00100000:1.0:1785390131.747463:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:1.0:1785390131.747472:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10219:x1872116847805312:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1785390131.747509:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390131.747592:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10219:x1872116847805312:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 Request processed in 120us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390131.747600:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:0.0:1785390131.761940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390131.763464:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805568 00000100:00100000:1.0:1785390131.763486:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805568 00000100:00100000:1.0:1785390131.763572:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:1.0:1785390131.763583:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:10219:x1872116847805568:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785390131.764202:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:10219:x1872116847805568:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 620us (2267us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1785390131.764211:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000020:00080000:1.0:1785390131.781779:0:5824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1785390131.781858:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1785390131.781869:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1785390132.240093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390132.240189:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805696 00000100:00100000:0.0:1785390132.240199:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805696 00000100:00100000:0.0:1785390132.240284:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00100000:0.0:1785390132.240293:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:11026:x1872116847805696:12345-192.168.202.54@tcp:101:lsof.0 00010000:00010000:0.0:1785390132.240312:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390132.240331:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c12a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390132.240562:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390132.240577:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390132.240588:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390132.240765:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785390132.240769:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390132.240874:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390132.240901:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390132.240917:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390132.240925:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390132.240928:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390132.240932:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:0.0:1785390132.241078:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+6:11026:x1872116847805696:12345-192.168.202.54@tcp:101:lsof.0 Request processed in 784us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390132.241090:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 136 00000100:00080000:2.0:1785390132.241193:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390132.247146:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879281024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390132.247208:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390132.247340:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281024 00000100:00100000:3.0:1785390132.247348:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281024 00000100:00100000:3.0:1785390132.247397:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1785390132.247407:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879281024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390132.247440:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390132.247493:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879281024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390132.247500:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1785390132.247591:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879281024:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1785390132.373943:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785390132.373953:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390132.374252:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1785390132.374259:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785390132.693685:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390133.687115:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390133.687163:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390133.687211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390133.687243:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390133.687271:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390133.687300:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806080 00000100:00100000:0.0:1785390133.687310:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806080 00000100:00100000:0.0:1785390133.687365:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806208 00000100:00100000:0.0:1785390133.687369:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806208 00000100:00100000:0.0:1785390133.687393:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1785390133.687403:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847806080:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390133.687474:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847806080:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 72us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390133.687482:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1785390133.687498:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1785390133.687504:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847806208:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390133.687556:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847806208:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 52us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390133.687562:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:0.0:1785390133.687586:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806336 00000100:00100000:0.0:1785390133.687601:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806336 00000100:00100000:0.0:1785390133.687623:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805952 00000100:00100000:0.0:1785390133.687626:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805952 00000100:00100000:0.0:1785390133.687644:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:0.0:1785390133.687650:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:2357:x1872116847806336:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390133.687811:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847805824 00000100:00100000:2.0:1785390133.687815:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847805824 00000100:00100000:2.0:1785390133.687843:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 314 00000100:00100000:2.0:1785390133.687849:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847805824:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390133.687877:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847805824:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390133.687884:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 314 00000100:00080000:2.0:1785390133.687929:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785390133.687939:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390133.687941:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390133.688054:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:2.0:1785390133.688062:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2357:x1872116847805952:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390133.688098:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2357:x1872116847805952:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 37us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390133.688105:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:0.0:1785390133.689336:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:2357:x1872116847806336:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 1684us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390133.689344:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 195 00010000:00010000:2.0:1785390133.717761:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390134.741680:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390135.765712:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390136.341863:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879281408:0@lo:400:kworker.0 00000100:00100000:2.0:1785390136.341889:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879281536:0@lo:400:kworker.0 00000100:00100000:0.0:1785390136.341996:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879281152:0@lo:400:kworker.0 00000100:00100000:3.0:1785390136.342054:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879281280:0@lo:400:kworker.0 00000100:00100000:2.0:1785390136.346394:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390136.346676:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281536 00000100:00100000:2.0:1785390136.346687:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281536 00000100:00100000:2.0:1785390136.346753:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1785390136.346762:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879281536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390136.346847:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879281536:12345-0@lo:400:kworker.0 Request processed in 85us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390136.346854:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1785390136.346881:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390136.347329:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879281536:0@lo:400:kworker.0 00000100:00100000:1.0:1785390136.361013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390136.361420:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281408 00000100:00100000:2.0:1785390136.361432:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281408 00000100:00100000:2.0:1785390136.361513:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1785390136.361544:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879281408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390136.361645:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879281408:12345-0@lo:400:kworker.0 Request processed in 123us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390136.361673:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1785390136.361699:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390136.361889:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879281408:0@lo:400:kworker.0 00000100:00100000:0.0:1785390136.362903:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390136.362951:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879281664:0@lo:400:kworker.0 00000100:00100000:1.0:1785390136.362995:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281152 00000100:00100000:1.0:1785390136.363001:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281152 00000100:00100000:0.0:1785390136.363003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390136.363032:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1785390136.363036:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281664 00000100:00100000:0.0:1785390136.363039:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281664 00000100:00100000:1.0:1785390136.363041:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390136.363072:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1785390136.363078:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879281664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390136.363085:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879281152:12345-0@lo:400:kworker.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390136.363092:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1785390136.363108:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879281664:12345-0@lo:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390136.363114:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1785390136.363128:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390136.363138:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879281152:0@lo:400:kworker.0 00000100:00100000:1.0:1785390136.363196:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879281664:0@lo:400:kworker.0 00000100:00100000:3.0:1785390136.372130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390136.372198:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879281792:0@lo:400:kworker.0 00000100:00100000:3.0:1785390136.372291:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390136.372666:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281280 00000100:00100000:2.0:1785390136.372678:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281280 00000100:00100000:2.0:1785390136.372741:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1785390136.372750:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879281280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390136.372830:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879281280:12345-0@lo:400:kworker.0 Request processed in 81us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390136.372839:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1785390136.373028:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a7e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879281280:0@lo:400:kworker.0 00000100:00100000:0.0:1785390136.374725:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281792 00000100:00100000:0.0:1785390136.374735:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281792 00000100:00100000:0.0:1785390136.374855:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1785390136.374865:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879281792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390136.374948:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879281792:12345-0@lo:400:kworker.0 Request processed in 85us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390136.374971:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1785390136.376142:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879281792:0@lo:400:kworker.0 00000100:00080000:2.0:1785390136.384794:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1785390136.790097:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390136.858095:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785390136.858125:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50698ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879281920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390136.858216:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390136.858302:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879281920 00000100:00100000:3.0:1785390136.858312:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879281920 00000100:00100000:3.0:1785390136.858373:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785390136.858384:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879281920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390136.858450:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390136.858504:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879281920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390136.858512:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1785390136.858599:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50698ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879281920:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1785390136.963435:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:2.0:1785390137.371179:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390137.371207:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879282048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390137.371289:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390137.378358:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282048 00000100:00100000:2.0:1785390137.378378:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282048 00000100:00100000:2.0:1785390137.378442:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785390137.378453:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879282048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390137.378504:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390137.378636:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879282048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (7347us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390137.378644:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1785390137.378715:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879282048:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1785390137.580422:0:12233:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:42:15 (1785390135) 00010000:00010000:2.0:1785390137.813986:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390138.798281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390138.798328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390138.798377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390138.798405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390138.798432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390138.798468:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806720 00000100:00100000:2.0:1785390138.798491:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806720 00000100:00100000:2.0:1785390138.798587:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806848 00000100:00100000:2.0:1785390138.798590:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806848 00000100:00100000:2.0:1785390138.798613:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:2.0:1785390138.798625:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847806720:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390138.798707:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847806720:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390138.798715:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:2.0:1785390138.798731:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00100000:2.0:1785390138.798737:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847806848:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390138.798772:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847806848:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390138.798779:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 115 00000100:00080000:2.0:1785390138.798795:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390138.798800:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390138.798926:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806464 00000100:00100000:0.0:1785390138.798931:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806464 00000100:00100000:0.0:1785390138.798970:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 316 00000100:00100000:0.0:1785390138.798978:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847806464:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390138.799008:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847806464:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390138.799014:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 316 00000100:00100000:1.0:1785390138.799228:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806976 00000100:00100000:1.0:1785390138.799233:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806976 00000100:00100000:1.0:1785390138.799285:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847806592 00000100:00100000:1.0:1785390138.799288:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847806592 00000100:00100000:1.0:1785390138.799310:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1785390138.799316:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:2358:x1872116847806976:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390138.799356:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:2358:x1872116847806976:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390138.799362:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1785390138.799373:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:1.0:1785390138.799378:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:2358:x1872116847806592:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390138.799396:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:2358:x1872116847806592:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 18us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390138.799401:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00080000:2.0:1785390138.800025:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785390138.838651:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390139.123466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390139.123756:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847807232 00000100:00100000:1.0:1785390139.123769:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847807232 00000100:00100000:1.0:1785390139.123854:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:1.0:1785390139.123866:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:11291:x1872116847807232:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390139.124195:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390139.124222:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed5b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c131 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.124314:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.124329:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.124341:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.124355:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.124377:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.124383:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.125925:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed5c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.125954:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.125965:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390139.125978:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1785390139.126242:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126251:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126258:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126265:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390139.126270:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126277:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126302:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf50629bc00) 00010000:00010000:1.0:1785390139.126305:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390139.126311:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126318:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed5b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126333:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126339:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126344:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126350:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390139.126352:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126358:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126365:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cf510c5a600) 00010000:00010000:1.0:1785390139.126367:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390139.126370:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.126376:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed5be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.130338:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed5b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c131 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.130370:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c131 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390139.130381:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:1.0:1785390139.130384:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390139.130388:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390139.130480:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:11291:x1872116847807232:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 6613us (7026us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1785390139.130490:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 137 00000100:00100000:0.0:1785390139.153247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390139.153322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390139.153560:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847807360 00000100:00100000:3.0:1785390139.153574:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847807360 00000100:00100000:3.0:1785390139.153648:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:3.0:1785390139.153659:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:2360:x1872116847807360:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390139.153678:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390139.153708:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed5c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c131 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390139.153732:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:3.0:1785390139.153738:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390139.153884:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:2360:x1872116847807360:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 224us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390139.153892:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1785390139.155767:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847807488 00000100:00100000:2.0:1785390139.155778:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847807488 00000100:00100000:2.0:1785390139.155830:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:2.0:1785390139.155839:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11291:x1872116847807488:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1785390139.156237:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11291:x1872116847807488:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 397us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390139.156268:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000040:00080000:2.0:1785390139.555583:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785390139.555596:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390139.555640:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1785390139.555648:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1785390139.868262:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390140.885820:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390141.462048:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879282304:0@lo:400:kworker.0 00000100:00100000:0.0:1785390141.462110:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879282432:0@lo:400:kworker.0 00000100:00100000:3.0:1785390141.462144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390141.462222:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879282176:0@lo:400:kworker.0 00000100:00100000:3.0:1785390141.462239:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879282816:0@lo:400:kworker.0 00000100:00100000:0.0:1785390141.462300:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282304 00000100:00100000:0.0:1785390141.462309:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282304 00000100:00100000:0.0:1785390141.462364:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1785390141.462372:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879282304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390141.467948:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390141.469038:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53591aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879282560:0@lo:400:kworker.0 00000100:00100000:3.0:1785390141.469098:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390141.469501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390141.469551:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282816 00000100:00100000:2.0:1785390141.469562:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282816 00000100:00100000:3.0:1785390141.469576:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282176 00000100:00100000:3.0:1785390141.469580:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282176 00000100:00100000:3.0:1785390141.469631:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1785390141.469642:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879282176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.469916:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282560 00000100:00100000:2.0:1785390141.469929:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282560 00000100:00100000:2.0:1785390141.469953:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1785390141.469959:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879282816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.470139:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879282816:12345-0@lo:400:kworker.0 Request processed in 178us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390141.470146:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1785390141.470165:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1785390141.470172:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879282560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.470207:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879282560:12345-0@lo:400:kworker.0 Request processed in 35us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390141.470213:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1785390141.470232:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390141.470237:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390141.470459:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53591aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879282560:0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.470702:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879282816:0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.470762:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879282176:0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.470774:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879282688:0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.470810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390141.470891:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282688 00000100:00100000:2.0:1785390141.470896:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282688 00000100:00100000:2.0:1785390141.471111:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1785390141.471120:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879282688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390141.471155:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879282688:12345-0@lo:400:kworker.0 Request processed in 38us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390141.471161:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1785390141.471175:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390141.471191:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879282688:0@lo:400:kworker.0 00000100:00100000:0.0:1785390141.471693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390141.471742:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879282432 00000100:00100000:0.0:1785390141.471746:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879282432 00000100:00100000:0.0:1785390141.471777:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1785390141.471784:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879282432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390141.471824:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879282432:12345-0@lo:400:kworker.0 Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390141.471887:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:0.0:1785390141.471904:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390141.472039:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879282432:0@lo:400:kworker.0 00000100:00100000:0.0:1785390141.472088:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879282304:12345-0@lo:400:kworker.0 Request processed in 9717us (9944us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390141.472095:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1785390141.472120:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879282304:0@lo:400:kworker.0 00000100:00100000:3.0:1785390141.472838:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879282176:12345-0@lo:400:kworker.0 Request processed in 3196us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390141.473246:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1785390141.850082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390141.852235:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847807616 00000100:00100000:3.0:1785390141.852249:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847807616 00000100:00100000:3.0:1785390141.852327:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:3.0:1785390141.852337:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11333:x1872116847807616:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390141.852362:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390141.852386:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed5d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c138 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852466:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852484:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852498:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852513:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852519:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852556:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852916:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852925:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852932:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852939:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390141.852944:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852953:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852968:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390141.852971:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390141.852976:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852982:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed5da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852993:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.852999:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853010:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853015:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390141.853018:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853025:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853033:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cf520a1dd00) 00010000:00010000:3.0:1785390141.853036:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390141.853039:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853045:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853086:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed5d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c138 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853097:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390141.853100:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390141.853103:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed5d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c138 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.853112:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785390141.853178:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11333:x1872116847807616:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 842us (3110us total) trans 0 rc 301/301 00000100:00100000:3.0:1785390141.853194:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00080000:1.0:1785390141.862067:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390141.868789:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390141.869184:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847807872 00000100:00100000:0.0:1785390141.869196:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847807872 00000100:00100000:0.0:1785390141.869267:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 140 00000100:00100000:0.0:1785390141.869277:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11333:x1872116847807872:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:0.0:1785390141.869346:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390141.872565:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ecf51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf71 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.872679:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390141.872687:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390141.879900:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.879936:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.879947:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.879997:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.880015:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 5 pid: 5804 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390141.880039:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879282944:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390141.880150:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0300 going to sleep for 11 seconds 00000100:00100000:1.0:1785390141.899881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390141.900010:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808000 00000100:00100000:3.0:1785390141.900022:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808000 00010000:00010000:3.0:1785390141.900095:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 6 pid: 5804 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390141.900138:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:3.0:1785390141.900148:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:2359:x1872116847808000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390141.900166:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390141.900173:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 6 pid: 5804 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.900187:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 6 pid: 5804 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.900212:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390141.900219:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.900229:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.900237:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.900256:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390141.900308:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:2359:x1872116847808000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 161us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390141.900324:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00010000:00010000:0.0:1785390141.900450:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed5a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c12a expref: 5 pid: 5804 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390141.900470:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879282944:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390141.900494:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.900504:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.900510:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.900563:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.900572:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.900580:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785390141.901837:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1785390141.905298:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1785390141.905321:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.905333:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.905348:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.905355:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390141.905360:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.905369:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.907400:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390141.907411:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390141.907421:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.907433:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed5e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390141.907464:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a871d433 reply state 00000000f0ab1799 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390141.907476:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785390141.907631:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+15:11333:x1872116847807872:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 38349us (38850us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1785390141.907641:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 140 00010000:00010000:3.0:1785390141.912125:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.912147:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.912155:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.912162:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390141.912169:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.912178:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.912198:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cf50896c500) 00010000:00010000:3.0:1785390141.912201:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390141.912207:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390141.912214:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed5ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390141.913923:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390141.974162:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390141.974192:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879283072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390141.974281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390141.974361:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879283072 00000100:00100000:1.0:1785390141.974371:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879283072 00000100:00100000:1.0:1785390141.981881:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785390141.981899:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879283072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390141.981951:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390141.982071:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879283072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (7789us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390141.982089:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1785390141.982162:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879283072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390142.137510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.137590:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808128 00000001:00080000:1.0:1785390142.137591:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:3.0:1785390142.137605:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808128 00000100:00100000:3.0:1785390142.137675:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:3.0:1785390142.137685:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+12:11341:x1872116847808128:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:3.0:1785390142.137708:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.137750:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed5f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c13f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.137811:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.137825:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.137837:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390142.138014:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785390142.138018:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390142.138087:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.138111:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c13f expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.138125:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c13f expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.138133:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:3.0:1785390142.138136:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390142.138140:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5e00, rc 0) 00000100:00100000:3.0:1785390142.138191:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:11341:x1872116847808128:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 508us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.138198:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 141 00000100:00100000:1.0:1785390142.266416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.266506:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808256 00000100:00100000:3.0:1785390142.266583:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808256 00000100:00100000:3.0:1785390142.266635:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:3.0:1785390142.266645:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+13:11347:x1872116847808256:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390142.266666:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.266687:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c146 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.266784:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.266798:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.266810:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.266826:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.266832:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.266838:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267249:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267258:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267264:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390142.267351:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1785390142.267354:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390142.267430:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267445:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267451:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267458:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267463:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390142.267467:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267474:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267487:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:3.0:1785390142.267489:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390142.267494:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267500:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed60b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267512:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267574:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267580:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267585:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390142.267588:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267595:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267604:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cf520a1d600) 00010000:00010000:3.0:1785390142.267607:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390142.267609:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267615:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed612 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267644:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c146 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267657:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c146 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.267664:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390142.267667:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1785390142.267675:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4e00, rc 0) 00000100:00100000:3.0:1785390142.267737:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11347:x1872116847808256:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1092us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.267744:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 142 00000100:00100000:2.0:1785390142.277667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390142.277764:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808512 00000100:00100000:1.0:1785390142.277773:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808512 00000100:00100000:1.0:1785390142.277834:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:1.0:1785390142.277844:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+14:11347:x1872116847808512:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1785390142.277865:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390142.277884:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed620 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c14d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.278178:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.278193:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.278206:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.278267:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.278276:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.278283:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1785390142.279053:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1785390142.279288:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279297:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279304:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279336:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279343:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279349:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279355:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390142.279359:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279367:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279378:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390142.279381:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390142.279385:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279401:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed627 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390142.279415:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059c927b4 reply state 00000000cc6e95fd transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390142.279424:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1785390142.279450:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed620 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279465:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.279472:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:1.0:1785390142.279474:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390142.279477:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785390142.279556:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:11347:x1872116847808512:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1713us (1898us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1785390142.279564:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 143 00000100:00100000:1.0:1785390142.291002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.291132:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808640 00000100:00100000:3.0:1785390142.291150:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808640 00010000:00010000:2.0:1785390142.291159:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.291173:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.291182:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.291188:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390142.291193:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.291201:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.291231:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf510c5a100) 00010000:00010000:2.0:1785390142.291235:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390142.291239:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.291246:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed62e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390142.291276:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1785390142.291291:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847808640:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390142.291315:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.291341:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c154 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785390142.291375:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390142.291409:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=450s v=(0 0) 00010000:00010000:3.0:1785390142.291415:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390142.291427:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 6 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.291448:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 6 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.291464:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785390142.291601:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2358:x1872116847808640:12345-192.168.202.54@tcp:101:bash.0 Request processed in 314us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.291610:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00080000:1.0:1785390142.291969:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390142.295491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.295619:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808768 00000100:00100000:3.0:1785390142.295628:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808768 00000100:00100000:3.0:1785390142.295702:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:3.0:1785390142.295712:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:11347:x1872116847808768:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390142.295739:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.295758:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c15b expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.295788:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.295796:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390142.295800:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390142.295805:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.295835:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.295849:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 7 pid: 7936 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390142.295863:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50698b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1872116879283200:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390142.295954:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390142.306714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.306833:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847808896 00000100:00100000:0.0:1785390142.306843:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847808896 00000100:00100000:3.0:1785390142.306868:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50698b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6598:1872116879283200:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390142.306886:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 8 pid: 7936 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390142.306956:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:0.0:1785390142.306967:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847808896:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390142.306982:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390142.307004:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 8 pid: 7936 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.307019:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 8 pid: 7936 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.307043:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097820478/0x33dffe75ff5ed643 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c154 expref: 8 pid: 7936 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.307060:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.307060:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390142.307071:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390142.307087:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.307114:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.307137:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4c00, rc 0) 00010000:00010000:0.0:1785390142.307156:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390142.307174:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879283328:192.168.202.54@tcp:105: 00000100:00100000:3.0:1785390142.307288:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:11347:x1872116847808768:12345-192.168.202.54@tcp:101:bash.0 Request processed in 11573us (11803us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.307300:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1785390142.314262:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0240 going to sleep for 11 seconds 00000100:00100000:1.0:1785390142.323143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.323866:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879283328:192.168.202.54@tcp:105: 00010000:00010000:0.0:1785390142.323891:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390142.323957:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847808896:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 16992us (17252us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390142.323969:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1785390142.327704:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847809152 00000100:00100000:3.0:1785390142.327735:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847809152 00000100:00100000:3.0:1785390142.327907:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:3.0:1785390142.327928:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+16:11347:x1872116847809152:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1785390142.329738:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:11347:x1872116847809152:12345-192.168.202.54@tcp:35:bash.0 Request processed in 1795us (6591us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1785390142.329751:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:1.0:1785390142.385122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390142.385186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.385296:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847809280 00000100:00100000:2.0:1785390142.385305:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847809408 00000100:00100000:3.0:1785390142.385310:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847809280 00000100:00100000:2.0:1785390142.385321:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847809408 00002000:00100000:3.0:1785390142.385392:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cf53fdfc000 x1872116847809280/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:128/0 lens 504/0 e 0 to 0 dl 1785390153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1785390142.385400:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00002000:00100000:3.0:1785390142.385415:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fdfc000 with x1872116847809280 ext(0->12) 00000100:00100000:2.0:1785390142.385418:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53596e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847809408:12345-192.168.202.54@tcp:16:kworker.0 00002000:00010000:3.0:1785390142.385427:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf53fdfc000 00000100:00100000:3.0:1785390142.385471:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1785390142.385485:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847809280:12345-192.168.202.54@tcp:4:bash.0 00000100:00100000:2.0:1785390142.385635:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53596e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847809408:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 218us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390142.385645:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1785390142.391187:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2358:x1872116847809280:12345-192.168.202.54@tcp:4:bash.0 Request processed in 5695us (6067us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1785390142.391205:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00002000:00100000:2.0:1785390142.391218:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cf53fdfc000 x1872116847809280/t4294967305(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:128/0 lens 504/448 e 0 to 0 dl 1785390153 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785390142.391228:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fdfc000 with x1872116847809280 ext(0->12) 00002000:00010000:2.0:1785390142.391234:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf53fdfc000 00000100:00100000:1.0:1785390142.433127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.433300:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847809664 00000100:00100000:3.0:1785390142.433314:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847809664 00000100:00100000:3.0:1785390142.433388:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:3.0:1785390142.433399:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:11358:x1872116847809664:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390142.433459:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.436850:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c162 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390142.437032:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1785390142.437327:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed651 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c162 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.437367:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:2.0:1785390142.437370:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785390142.437377:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c162 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.437395:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5200, rc 0) 00000100:00100000:2.0:1785390142.437495:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11358:x1872116847809664:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 4096us (4380us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1785390142.437505:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 144 00000100:00100000:0.0:1785390142.440099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.440191:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847809920 00000100:00100000:3.0:1785390142.440202:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847809920 00000100:00100000:3.0:1785390142.440270:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1785390142.440283:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11358:x1872116847809920:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390142.440790:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11358:x1872116847809920:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 509us (699us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1785390142.440799:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:0.0:1785390142.486061:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390142.486092:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879283456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390142.486188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390142.487164:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879283456 00000100:00100000:2.0:1785390142.487175:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879283456 00000100:00100000:2.0:1785390142.487245:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1785390142.487257:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879283456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390142.487288:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390142.487357:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879283456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390142.487366:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1785390142.487482:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879283456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390142.529399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.529574:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847810048 00000100:00100000:0.0:1785390142.529587:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847810048 00000100:00100000:0.0:1785390142.529661:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:0.0:1785390142.529673:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11364:x1872116847810048:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390142.529705:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390142.529742:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed65f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c169 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.529835:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.529852:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.529869:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390142.529970:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1785390142.529976:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390142.530004:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.530037:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed65f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c169 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.530061:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c169 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.530071:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390142.530074:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390142.530078:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717e00, rc 0) 00000100:00100000:0.0:1785390142.530159:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11364:x1872116847810048:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 488us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390142.530167:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 145 00000100:00100000:1.0:1785390142.541668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.544082:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847810304 00000100:00100000:0.0:1785390142.544100:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847810304 00000100:00100000:0.0:1785390142.544185:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:0.0:1785390142.544197:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11364:x1872116847810304:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390142.544225:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390142.544254:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed66d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c170 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.544388:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.544427:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.544441:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390142.544456:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785390142.545794:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed66d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c170 expref: 23 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.545821:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c170 expref: 22 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.545832:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:0.0:1785390142.545836:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390142.545841:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717400, rc 0) 00000100:00100000:0.0:1785390142.546035:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:11364:x1872116847810304:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1838us (4379us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1785390142.546045:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 146 00000100:00100000:2.0:1785390142.558869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390142.558930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.559575:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847810688 00000100:00100000:0.0:1785390142.559589:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847810688 00000100:00100000:0.0:1785390142.559667:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1785390142.559679:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:2359:x1872116847810688:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390142.559700:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390142.559743:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c170 expref: 22 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.559792:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:0.0:1785390142.559798:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390142.559875:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:2359:x1872116847810688:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 197us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390142.559884:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1785390142.564135:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847810560 00000100:00100000:3.0:1785390142.564156:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847810560 00000100:00100000:3.0:1785390142.564241:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:3.0:1785390142.564254:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:11364:x1872116847810560:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390142.564288:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.564317:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c177 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.564444:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.564479:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.564494:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390142.564568:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1785390142.564745:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c177 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.564768:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c177 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.564777:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:3.0:1785390142.564780:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785390142.564784:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785390142.564853:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11364:x1872116847810560:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 602us (6000us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1785390142.564861:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 147 00000100:00100000:1.0:1785390142.579217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.579332:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847810816 00000100:00100000:0.0:1785390142.579344:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847810816 00000100:00100000:0.0:1785390142.579411:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:0.0:1785390142.579423:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847810816:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:0.0:1785390142.579493:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.579520:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.579556:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1785390142.579561:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390142.579567:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.579613:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.579630:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 8 pid: 6598 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390142.579663:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879283584:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390142.579786:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1785390142.590446:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879283584:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390142.590497:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390142.595455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390142.595627:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847810944 00000100:00100000:2.0:1785390142.595640:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847810944 00010000:00010000:2.0:1785390142.595693:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 9 pid: 6598 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390142.595781:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:2.0:1785390142.595794:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2360:x1872116847810944:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390142.595828:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785390142.595854:0:5790:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785390142.595857:0:5790:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1785390142 00002000:00010000:2.0:1785390142.595860:0:5790:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1785390142 00010000:00010000:2.0:1785390142.595868:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 9 pid: 6598 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.595884:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 9 pid: 6598 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.595916:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed64a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c15b expref: 9 pid: 6598 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.595953:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390142.595958:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390142.595965:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.595976:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.596019:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390142.596163:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596174:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596205:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596215:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596224:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596232:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390142.596236:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596246:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596259:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390142.596267:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5ed697 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390142.596351:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847810944:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 559us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390142.596360:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:1.0:1785390142.603161:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847810816:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 23721us (23938us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390142.603180:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000040:00080000:2.0:1785390142.619085:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785390142.619100:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390142.619358:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1785390142.619366:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785390142.621308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.624680:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847811200 00000100:00100000:3.0:1785390142.624700:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847811200 00000100:00100000:2.0:1785390142.624872:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:2.0:1785390142.624886:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508785850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11364:x1872116847811200:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:2.0:1785390142.625622:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c177 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390142.626073:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1785390142.626126:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1785390142.628280:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1785390142.628378:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.628403:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.628414:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.628464:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.629064:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 27 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390142.629087:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50348ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1872116879283712:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390142.629262:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5235cfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390142.640571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.642301:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847811328 00000100:00100000:3.0:1785390142.642316:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847811328 00010000:00010000:3.0:1785390142.642370:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 28 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390142.642424:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:3.0:1785390142.642436:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e06a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:2359:x1872116847811328:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390142.642454:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390142.642462:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 28 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.642510:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 28 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.642566:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:3.0:1785390142.642574:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.642585:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.642594:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.642617:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390142.642686:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e06a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:2359:x1872116847811328:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 252us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.642695:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00010000:00010000:2.0:1785390142.645153:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c14d expref: 27 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390142.645198:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50348ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1872116879283712:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390142.645224:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.645235:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.645241:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390142.645397:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1785390142.645705:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1785390142.645849:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50348ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1872116879283840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1785390142.645940:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390142.645979:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5235cf780 going to sleep for 11 seconds 00000100:00100000:1.0:1785390142.647918:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879283840 00000100:00100000:1.0:1785390142.647930:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879283840 00000100:00100000:1.0:1785390142.648003:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785390142.648015:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1872116879283840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1785390142.648148:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1872116879283840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390142.648157:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785390142.648326:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50348ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1872116879283840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1785390142.649067:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1785390142.649156:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50698b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1872116879283968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1785390142.649202:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390142.649377:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdba0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390142.653002:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879283968 00000100:00100000:1.0:1785390142.653021:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879283968 00000100:00100000:1.0:1785390142.653089:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1785390142.653102:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1872116879283968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1785390142.653520:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1872116879283968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 421us (4316us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1785390142.653547:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785390142.655098:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50698b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1872116879283968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1785390142.657810:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1785390142.657900:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.658610:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.658621:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.658628:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390142.658633:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.658664:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.658684:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:2.0:1785390142.658688:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1785390142.658694:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390142.658701:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5ed69e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785390142.659836:0:5806:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1785390142.660089:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1785390142.660104:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451214579139ns, next at 452214575846ns, rc = 0 00000001:00080000:2.0:1785390142.660114:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1785390142.660169:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5af00) 00010000:00010000:2.0:1785390142.660173:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1785390142.660185:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c177 expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390142.660342:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508785850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:11364:x1872116847811200:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 35457us (39043us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1785390142.660352:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000020:00080000:2.0:1785390142.660358:0:5806:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1785390142.674842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.676933:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847811456 00000100:00100000:3.0:1785390142.676948:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847811456 00000100:00100000:3.0:1785390142.677036:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:3.0:1785390142.677049:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+30:11364:x1872116847811456:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390142.677102:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.677135:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed6a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c17e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.677219:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c17e expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.677238:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c17e expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.677262:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390142.677266:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390142.677270:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:3.0:1785390142.677354:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:11364:x1872116847811456:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 307us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.677363:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 148 00000100:00100000:1.0:1785390142.680258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.680341:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847811712 00000100:00100000:3.0:1785390142.680353:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847811712 00000100:00100000:3.0:1785390142.680418:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1785390142.680430:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:11364:x1872116847811712:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390142.680858:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11364:x1872116847811712:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 430us (608us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1785390142.680867:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:1.0:1785390142.811886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.812088:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847811968 00000100:00100000:3.0:1785390142.812101:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847811968 00000100:00100000:3.0:1785390142.812172:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:3.0:1785390142.812184:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11374:x1872116847811968:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390142.812237:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390142.812264:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c185 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390142.812415:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1785390142.812764:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c185 expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.812782:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:3.0:1785390142.812785:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390142.812792:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c185 expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.812810:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4800, rc 0) 00000100:00100000:3.0:1785390142.812888:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:11374:x1872116847811968:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 706us (1016us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1785390142.812898:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 149 00000100:00100000:1.0:1785390142.828477:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.828587:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847812096 00000100:00100000:3.0:1785390142.828601:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847812096 00000100:00100000:3.0:1785390142.828677:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:3.0:1785390142.828689:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:11374:x1872116847812096:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:3.0:1785390142.828809:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.828830:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.828857:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.828917:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.828926:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.828933:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829070:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829079:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829086:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785390142.829141:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829156:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829163:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829170:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829176:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390142.829181:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829197:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829211:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390142.829214:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390142.829219:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829226:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed6ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829242:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829249:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829255:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829260:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390142.829263:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829269:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829275:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf520a1d700) 00010000:00010000:3.0:1785390142.829278:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390142.829281:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829296:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829314:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829320:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829325:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829330:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390142.829333:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829339:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829346:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390142.829349:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390142.829352:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.829358:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390142.829448:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:11374:x1872116847812096:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 760us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.829457:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 150 00000100:00100000:1.0:1785390142.836550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.836653:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847812352 00000100:00100000:0.0:1785390142.836683:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847812352 00000100:00100000:0.0:1785390142.836775:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:0.0:1785390142.836786:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:11374:x1872116847812352:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1785390142.837135:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:11374:x1872116847812352:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 350us (618us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1785390142.837144:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00010000:00010000:3.0:1785390142.935314:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390142.941699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.941851:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847812608 00000100:00100000:0.0:1785390142.941865:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847812608 00000100:00100000:0.0:1785390142.941956:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:0.0:1785390142.941968:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:11377:x1872116847812608:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390142.942002:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390142.942032:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed6cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c18c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942138:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942176:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942191:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942208:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942216:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942223:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942379:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942387:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942395:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390142.942406:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1785390142.942573:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942582:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942590:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942604:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390142.942609:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942617:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942631:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390142.942635:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390142.942640:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942647:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942664:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942670:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942677:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942683:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390142.942686:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942693:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942723:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50896cd00) 00010000:00010000:0.0:1785390142.942726:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390142.942730:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942736:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed6dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942784:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed6cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 37 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942799:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390142.942807:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390142.942810:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390142.942812:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:0.0:1785390142.942889:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:11377:x1872116847812608:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 922us (1214us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1785390142.942898:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 151 00000100:00100000:1.0:1785390142.958762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390142.958933:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847812736 00000100:00100000:3.0:1785390142.958952:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847812736 00000100:00100000:3.0:1785390142.959076:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:3.0:1785390142.959088:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:11377:x1872116847812736:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1785390142.959180:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959203:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959217:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959250:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959258:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959265:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959272:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390142.959277:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959285:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959297:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390142.959301:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390142.959315:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390142.959322:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed6f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390142.959414:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:11377:x1872116847812736:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 328us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390142.959423:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 152 00000100:00100000:2.0:1785390142.964489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390142.966601:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847812992 00000100:00100000:0.0:1785390142.966618:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847812992 00000100:00100000:0.0:1785390142.966693:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:0.0:1785390142.966705:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:11377:x1872116847812992:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1785390142.967058:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+37:11377:x1872116847812992:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 354us (2591us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1785390142.967066:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000001:00080000:0.0:1785390143.098655:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1785390143.098676:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1785390143.290215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390143.290314:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847813248 00000100:00100000:0.0:1785390143.290325:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847813248 00000100:00100000:0.0:1785390143.290403:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:0.0:1785390143.290417:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+37:11408:x1872116847813248:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1785390143.290447:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390143.290471:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed6f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c193 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.290619:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.290633:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.290645:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390143.290656:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00080000:1.0:1785390143.291030:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785390143.291107:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed6f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c193 expref: 40 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.291125:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c193 expref: 39 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.291132:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390143.291134:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390143.291137:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716800, rc 0) 00000100:00100000:0.0:1785390143.291244:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11408:x1872116847813248:12345-192.168.202.54@tcp:101:cat.0 Request processed in 832us (1041us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1785390143.291265:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 153 00000100:00100000:2.0:1785390143.297691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390143.297783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390143.297840:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847813632 00000100:00100000:3.0:1785390143.297853:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847813632 00000100:00100000:3.0:1785390143.298001:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1785390143.298012:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:2358:x1872116847813632:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390143.298031:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390143.298060:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c193 expref: 39 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.298082:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390143.298087:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390143.298156:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:2358:x1872116847813632:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390143.298163:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1785390143.300934:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847813504 00000100:00100000:0.0:1785390143.301106:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847813504 00000100:00100000:0.0:1785390143.301192:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:0.0:1785390143.301202:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:11408:x1872116847813504:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:0.0:1785390143.301781:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11408:x1872116847813504:12345-192.168.202.54@tcp:35:cat.0 Request processed in 579us (4102us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1785390143.301788:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:2.0:1785390143.368900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390143.373731:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847813888 00000100:00100000:0.0:1785390143.373752:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847813888 00000100:00100000:0.0:1785390143.373911:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:0.0:1785390143.373924:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11414:x1872116847813888:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:0.0:1785390143.373965:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390143.373969:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785390143.374005:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c169 expref: 39 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.374028:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390143.374033:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390143.374049:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed70e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c19a expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.374180:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.374193:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 39 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.374219:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.374261:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 39 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.374275:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 39 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390143.374289:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879284096:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390143.374410:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf52021bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390143.378763:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879284096:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390143.378799:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390143.383157:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390143.389649:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847814016 00000100:00100000:3.0:1785390143.389667:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847814016 00010000:00010000:3.0:1785390143.389738:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 40 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390143.389798:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:3.0:1785390143.389810:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:2359:x1872116847814016:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390143.389852:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390143.389862:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 40 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.389877:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 40 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.389905:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed6e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c18c expref: 40 pid: 5802 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.389936:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390143.389941:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.390742:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.390752:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.390801:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390143.390890:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:2359:x1872116847814016:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1080us (7741us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390143.390908:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00010000:00010000:2.0:1785390143.392768:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.392783:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390143.392811:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1785390143.393045:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed70e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 40 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.393069:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 39 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.393080:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:2.0:1785390143.393084:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785390143.393087:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:2.0:1785390143.393136:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11414:x1872116847813888:12345-192.168.202.54@tcp:101:dd.0 Request processed in 19216us (24251us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1785390143.393144:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 154 00000100:00100000:2.0:1785390143.399679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390143.399793:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847814272 00000100:00100000:3.0:1785390143.399806:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847814272 00000100:00100000:3.0:1785390143.399875:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 155 00000100:00100000:3.0:1785390143.399884:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11414:x1872116847814272:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:3.0:1785390143.400237:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.400257:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.400272:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390143.400326:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1785390143.400347:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a44cc7bd reply state 000000001ab96b04 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390143.400358:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390143.400488:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:11414:x1872116847814272:12345-192.168.202.54@tcp:36:dd.0 Request processed in 603us (821us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1785390143.400496:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 155 00000020:00080000:3.0:1785390143.400501:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785390143.408148:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.408168:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.408176:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.408182:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390143.408187:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.408195:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.408233:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390143.408236:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390143.408242:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.408248:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390143.804429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390143.804664:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847814400 00000100:00100000:3.0:1785390143.804678:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847814400 00000100:00100000:3.0:1785390143.804764:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:3.0:1785390143.804776:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+41:11428:x1872116847814400:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:3.0:1785390143.804809:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390143.804835:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed72a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1a1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.804970:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.804987:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805003:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805020:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805028:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805048:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805172:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805184:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 42 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805193:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805235:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 42 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.805252:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 42 pid: 7121 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390143.805270:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879284224:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390143.805396:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390143.811348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390143.811483:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847814656 00000100:00100000:0.0:1785390143.811496:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847814656 00000100:00100000:0.0:1785390143.811594:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1785390143.811606:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:5579:x1872116847814656:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785390143.812063:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:5579:x1872116847814656:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 457us (727us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1785390143.812072:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1785390143.812599:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879284224:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390143.812632:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390143.814431:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390143.814606:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847814784 00000100:00100000:0.0:1785390143.814616:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847814784 00010000:00010000:0.0:1785390143.814658:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 44 pid: 7121 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390143.814738:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:0.0:1785390143.814747:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:2359:x1872116847814784:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390143.814765:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390143.814773:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 44 pid: 7121 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.814786:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 44 pid: 7121 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.814814:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed715 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c19a expref: 44 pid: 7121 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.814836:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390143.814841:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.814852:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.814859:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390143.814949:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390143.815019:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:2359:x1872116847814784:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 272us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390143.815027:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00010000:00010000:2.0:1785390143.826113:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826137:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390143.826206:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1785390143.826211:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390143.826270:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826290:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826302:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826309:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826318:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826325:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390143.826329:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826339:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826358:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390143.826361:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390143.826366:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826374:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826395:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826402:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826414:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826419:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390143.826422:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826428:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826450:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf520a1d700) 00010000:00010000:2.0:1785390143.826452:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390143.826455:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826461:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826544:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed72a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a1 expref: 43 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826564:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a1 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.826573:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:2.0:1785390143.826575:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390143.826577:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4c00, rc 0) 00000100:00100000:2.0:1785390143.826679:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:11428:x1872116847814400:12345-192.168.202.54@tcp:101:stat.0 Request processed in 21904us (22262us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390143.826848:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 156 00000100:00100000:1.0:1785390143.896211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390143.896322:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815040 00000100:00100000:3.0:1785390143.896335:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815040 00000100:00100000:3.0:1785390143.896465:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 157 00000100:00100000:3.0:1785390143.896477:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:11434:x1872116847815040:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:3.0:1785390143.896599:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390143.896631:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed73f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a1 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.896656:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390143.896661:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390143.896917:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.896931:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390143.896942:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390143.896995:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1785390143.897016:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004d8503e reply state 000000007ddfef1e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390143.897025:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390143.897117:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:11434:x1872116847815040:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 643us (920us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1785390143.897125:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 157 00000020:00080000:3.0:1785390143.897130:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785390143.907981:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.908006:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.908016:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.908023:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390143.908029:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.908038:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.908058:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:2.0:1785390143.908062:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390143.908067:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390143.908073:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390143.920343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390143.920389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390143.920416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390143.921836:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815168 00000100:00100000:2.0:1785390143.921852:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815168 00000100:00100000:2.0:1785390143.921924:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 318 00000100:00100000:2.0:1785390143.921934:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847815168:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390143.922026:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2359:x1872116847815168:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 94us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390143.922050:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 318 00000100:00100000:0.0:1785390143.922221:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815424 00000100:00100000:0.0:1785390143.922235:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815424 00000100:00100000:0.0:1785390143.922283:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815296 00000100:00100000:0.0:1785390143.922287:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815296 00000100:00100000:0.0:1785390143.922309:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1785390143.922316:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847815424:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390143.922351:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847815424:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390143.922357:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 118 00000100:00100000:0.0:1785390143.922369:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00100000:0.0:1785390143.922375:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847815296:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390143.922398:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2359:x1872116847815296:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390143.922404:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 119 00000100:00080000:1.0:1785390143.925179:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390143.950396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390143.954329:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815552 00000100:00100000:2.0:1785390143.954348:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815552 00000100:00100000:2.0:1785390143.954464:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:2.0:1785390143.954476:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847815552:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390143.954625:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2359:x1872116847815552:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 151us (4240us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390143.954633:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00080000:1.0:1785390143.955316:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1785390143.958902:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390144.218316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390144.218403:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815680 00000100:00100000:0.0:1785390144.218415:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815680 00000100:00100000:0.0:1785390144.218482:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:0.0:1785390144.218492:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:11448:x1872116847815680:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:0.0:1785390144.218565:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390144.218594:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed74d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1a8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218682:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218715:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218748:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218767:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218775:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218782:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218919:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218928:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.218934:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390144.219065:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1785390144.219070:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390144.219093:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219105:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219114:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219129:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219135:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219141:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390144.219145:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219152:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219165:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390144.219168:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390144.219174:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219180:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219196:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219202:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219209:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219214:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390144.219224:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219231:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219240:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50896cd00) 00010000:00010000:0.0:1785390144.219243:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390144.219246:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219252:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed75b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219287:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed74d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 45 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219303:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 44 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.219311:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390144.219314:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390144.219316:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:0.0:1785390144.219390:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:11448:x1872116847815680:12345-192.168.202.54@tcp:101:stat.0 Request processed in 899us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390144.219398:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 158 00000100:00100000:1.0:1785390144.355784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390144.356075:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847815936 00000100:00100000:2.0:1785390144.356088:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847815936 00000100:00100000:2.0:1785390144.356155:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:2.0:1785390144.356167:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:11458:x1872116847815936:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390144.356195:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390144.356222:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1af expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390144.356365:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1785390144.356519:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed769 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1af expref: 46 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390144.356576:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:2.0:1785390144.356579:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785390144.356586:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ed769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1af expref: 46 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390144.356625:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c800, rc 0) 00000100:00100000:2.0:1785390144.356907:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+45:11458:x1872116847815936:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 741us (1133us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1785390144.356916:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 159 00000100:00100000:1.0:1785390144.360405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390144.365765:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847816192 00000100:00100000:0.0:1785390144.365783:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847816192 00000100:00100000:0.0:1785390144.366082:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:0.0:1785390144.366095:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508785050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+45:11458:x1872116847816192:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:0.0:1785390144.366461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508785050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:11458:x1872116847816192:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 368us (6075us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1785390144.366470:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:1.0:1785390144.499856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390144.500887:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847816448 00000100:00100000:0.0:1785390144.501053:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847816448 00000100:00100000:0.0:1785390144.501128:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:0.0:1785390144.501140:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+46:11464:x1872116847816448:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390144.501174:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390144.501205:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed777 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1b6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.501343:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.501360:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.501370:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.501413:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.501430:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 47 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390144.501446:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879284352:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390144.501836:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf509e38600 going to sleep for 11 seconds 00000100:00100000:0.0:1785390144.504558:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879284352:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390144.504589:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390144.505553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.505821:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847816576 00000100:00100000:3.0:1785390144.505831:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847816576 00010000:00010000:3.0:1785390144.505875:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 48 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390144.505929:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:3.0:1785390144.505963:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:2359:x1872116847816576:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390144.505983:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390144.505991:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 48 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.506006:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 48 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.506035:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1a8 expref: 48 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.506055:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390144.506060:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.506072:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.506080:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.506113:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390144.506170:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:2359:x1872116847816576:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 208us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390144.506177:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00010000:00010000:1.0:1785390144.506997:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.507007:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390144.507030:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1785390144.507221:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed777 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 48 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.507243:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.507251:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:1.0:1785390144.507265:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785390144.507269:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717000, rc 0) 00000100:00100000:1.0:1785390144.507326:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:11464:x1872116847816448:12345-192.168.202.54@tcp:101:bash.0 Request processed in 6187us (7484us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1785390144.507334:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 160 00000100:00100000:1.0:1785390144.515133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390144.515376:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847816832 00000100:00100000:0.0:1785390144.515389:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847816832 00000100:00100000:0.0:1785390144.515470:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 161 00000100:00100000:0.0:1785390144.515480:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+47:11464:x1872116847816832:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:0.0:1785390144.515880:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.516266:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.516283:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785390144.516348:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1785390144.516374:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036c5da2c reply state 00000000168a418c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390144.516384:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785390144.516542:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:11464:x1872116847816832:12345-192.168.202.54@tcp:36:bash.0 Request processed in 1062us (1420us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1785390144.516550:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 161 00000020:00080000:0.0:1785390144.516555:0:5803:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785390144.528324:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.528349:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.528379:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.528386:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390144.528391:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.528400:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.528421:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390144.528424:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390144.528430:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.528438:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed78c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390144.529516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.529771:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847816960 00000100:00100000:3.0:1785390144.529784:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847816960 00000100:00100000:3.0:1785390144.529886:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:3.0:1785390144.529906:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+49:11464:x1872116847816960:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390144.529940:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390144.529971:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.530079:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.530096:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 50 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.530116:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.530156:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 50 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.530173:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 50 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390144.530189:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879284480:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390144.530288:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1785390144.533264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.533727:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879284480:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390144.533758:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390144.533875:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847817088 00000100:00100000:1.0:1785390144.533885:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847817088 00010000:00010000:0.0:1785390144.534095:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 51 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390144.534184:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:0.0:1785390144.534194:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:2359:x1872116847817088:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390144.534212:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390144.534220:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 51 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.534234:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 51 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.534262:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed77e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1b6 expref: 51 pid: 5802 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.534280:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390144.534286:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.534296:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.534305:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.534340:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390144.534395:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:2359:x1872116847817088:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 202us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390144.534402:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00010000:00010000:1.0:1785390144.534450:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.534465:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390144.534517:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1785390144.534537:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390144.534559:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.534596:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1bd expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.534614:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1bd expref: 49 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.534622:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:1.0:1785390144.534625:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390144.534628:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:1.0:1785390144.534655:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+49:11464:x1872116847816960:12345-192.168.202.54@tcp:101:bash.0 Request processed in 4761us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390144.534667:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 162 00000100:00100000:2.0:1785390144.537258:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.537379:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847817344 00000100:00100000:3.0:1785390144.537389:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847817344 00000100:00100000:3.0:1785390144.537438:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:3.0:1785390144.537447:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+49:11464:x1872116847817344:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1785390144.537801:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:11464:x1872116847817344:12345-192.168.202.54@tcp:35:bash.0 Request processed in 354us (551us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1785390144.537810:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:2.0:1785390144.616799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.617017:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847817600 00000100:00100000:1.0:1785390144.617030:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847817600 00000100:00100000:1.0:1785390144.617108:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:1.0:1785390144.617120:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:11474:x1872116847817600:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390144.617164:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390144.617192:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed7a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1c4 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390144.617422:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1785390144.617832:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed7a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1c4 expref: 52 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.617850:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:1.0:1785390144.617854:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390144.617859:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1c4 expref: 52 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.617876:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390144.618474:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:11474:x1872116847817600:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1355us (1684us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1785390144.618483:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 163 00000100:00100000:2.0:1785390144.621416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.621682:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847817728 00000100:00100000:1.0:1785390144.621694:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847817728 00000100:00100000:1.0:1785390144.621806:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:1.0:1785390144.621817:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:11474:x1872116847817728:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:1.0:1785390144.624675:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.624710:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.624726:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.624743:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.624749:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.624754:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.624883:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625285:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625296:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390144.625347:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625360:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625386:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625392:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625398:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390144.625403:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625411:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625425:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390144.625428:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390144.625433:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625440:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625617:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625625:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625630:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625634:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390144.625643:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625649:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625656:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390144.625658:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390144.625661:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625666:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625682:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625686:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625690:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625695:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390144.625707:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625713:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625719:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:1.0:1785390144.625720:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390144.625728:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.625733:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed7bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390144.625908:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:11474:x1872116847817728:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 4087us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390144.625920:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 164 00000100:00100000:2.0:1785390144.629122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.629315:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847817984 00000100:00100000:1.0:1785390144.629327:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847817984 00000100:00100000:1.0:1785390144.629421:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1785390144.629432:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:11474:x1872116847817984:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390144.629963:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:11474:x1872116847817984:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 532us (847us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1785390144.629972:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:2.0:1785390144.671678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390144.671831:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847818240 00000100:00100000:0.0:1785390144.671862:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847818240 00000100:00100000:0.0:1785390144.671953:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:0.0:1785390144.671965:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53b9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:11477:x1872116847818240:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390144.671998:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390144.672023:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed7c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1cb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672114:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672129:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672141:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672166:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672173:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672180:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672345:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed7d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672354:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672361:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390144.672377:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1785390144.672494:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672502:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672509:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672514:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390144.672518:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672554:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672575:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390144.672577:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390144.672582:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672587:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672599:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672605:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672619:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672624:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390144.672626:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672631:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672637:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50896cd00) 00010000:00010000:0.0:1785390144.672640:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390144.672642:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672647:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed7d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672686:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed7c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1cb expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672707:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1cb expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390144.672714:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:0.0:1785390144.672716:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390144.672718:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717e00, rc 0) 00000100:00100000:0.0:1785390144.672784:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53b9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11477:x1872116847818240:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 822us (1118us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1785390144.672799:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 165 00000100:00100000:2.0:1785390144.682861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.683508:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847818368 00000100:00100000:3.0:1785390144.683521:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847818368 00000100:00100000:3.0:1785390144.683633:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:3.0:1785390144.683643:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11477:x1872116847818368:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1785390144.683766:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683786:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683799:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683833:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683842:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683850:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683857:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390144.683862:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683871:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683884:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390144.683888:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390144.683903:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.683910:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5ed7e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390144.684287:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11477:x1872116847818368:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 643us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390144.684296:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 166 00000100:00100000:1.0:1785390144.684474:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.684845:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847818496 00000100:00100000:3.0:1785390144.684851:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847818496 00000100:00100000:3.0:1785390144.685041:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1785390144.685050:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:2359:x1872116847818496:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390144.685062:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390144.685080:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed7d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1cb expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.685092:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390144.685096:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390144.685129:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:2359:x1872116847818496:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 81us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390144.685135:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1785390144.688773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.688871:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847818752 00000100:00100000:3.0:1785390144.688882:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847818752 00000100:00100000:3.0:1785390144.688952:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:3.0:1785390144.688963:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+53:11477:x1872116847818752:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390144.689251:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11477:x1872116847818752:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 289us (486us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1785390144.689259:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:0.0:1785390144.838428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.838582:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847819008 00000100:00100000:1.0:1785390144.838595:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847819008 00000100:00100000:1.0:1785390144.838657:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:1.0:1785390144.838667:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11495:x1872116847819008:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:1.0:1785390144.838705:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390144.838730:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1d2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.838852:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.838902:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.838917:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390144.838931:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1785390144.839095:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed7ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1d2 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.839118:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1d2 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.839128:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:1.0:1785390144.839131:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785390144.839135:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785390144.839324:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11495:x1872116847819008:12345-192.168.202.54@tcp:101:cat.0 Request processed in 657us (906us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1785390144.839332:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 167 00000100:00100000:2.0:1785390144.897909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.898066:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847819136 00000100:00100000:1.0:1785390144.898079:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847819136 00000100:00100000:1.0:1785390144.898147:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:1.0:1785390144.898168:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11496:x1872116847819136:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390144.898199:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390144.898238:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1d9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.898352:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed80a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.898382:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.898397:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390144.898486:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1785390144.898491:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390144.898519:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.898597:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1d9 expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.898621:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1d9 expref: 57 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.898630:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390144.898634:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390144.898638:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390144.898721:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11496:x1872116847819136:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 556us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390144.898729:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 168 00000100:00100000:3.0:1785390144.908981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390144.909183:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847819520 00000100:00100000:2.0:1785390144.909196:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847819520 00000100:00100000:2.0:1785390144.909271:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:2.0:1785390144.909283:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11496:x1872116847819520:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1785390144.909785:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11496:x1872116847819520:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 503us (816us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1785390144.909794:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1785390144.915181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390144.915333:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847819648 00000100:00100000:3.0:1785390144.915371:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847819648 00000100:00100000:3.0:1785390144.915465:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:3.0:1785390144.915477:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e06a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11496:x1872116847819648:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:3.0:1785390144.915496:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1785390144.915765:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed79a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1bd expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.915792:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed7f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1d2 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.915805:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed6a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c17e expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390144.915817:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390144.915831:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390144.920744:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e06a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:11496:x1872116847819648:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 5251us (5556us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390144.920764:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785390144.924020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.924097:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847819776 00000100:00100000:1.0:1785390144.924108:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847819776 00000100:00100000:1.0:1785390144.924325:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:1.0:1785390144.924336:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:11496:x1872116847819776:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:1.0:1785390144.924499:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.924516:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.924552:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390144.924790:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1785390144.924898:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53ff8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:11496:x1872116847819776:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 557us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390144.924905:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 169 00000100:00100000:2.0:1785390144.951248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390144.951486:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847819904 00000100:00100000:1.0:1785390144.951499:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847819904 00000100:00100000:1.0:1785390144.951626:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 170 00000100:00100000:1.0:1785390144.951638:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:11498:x1872116847819904:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390144.951667:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390144.951702:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.951791:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.951809:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.951822:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.951858:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.951867:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.951874:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952038:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952048:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952056:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390144.952101:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1785390144.952106:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390144.952128:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952141:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952162:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952169:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952187:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952194:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390144.952199:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952463:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952478:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390144.952481:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390144.952487:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952494:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4600/0x33dffe75ff5ed81f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952509:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952515:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952615:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952623:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390144.952626:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952644:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952652:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390144.952654:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390144.952658:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952664:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4c00/0x33dffe75ff5ed826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952712:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ed818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 57 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952727:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390144.952734:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390144.952736:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390144.952739:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5800, rc 0) 00000100:00100000:1.0:1785390144.952808:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11498:x1872116847819904:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1172us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390144.952816:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 170 00010000:00010000:3.0:1785390144.983999:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785390145.688984:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785390145.688996:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785390145.689061:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1785390145.689070:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785390145.689215:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50698a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879284608:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785390145.689334:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53fdbaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390145.694138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.694225:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847820032 00000100:00100000:1.0:1785390145.694237:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847820032 00000100:00100000:1.0:1785390145.694318:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:1.0:1785390145.694329:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847820032:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785390145.694389:0:7121:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785390145.694754:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847820032:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 425us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390145.694762:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 171 00000100:00100000:0.0:1785390145.694877:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50698a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879284608:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1785390145.695295:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390145.720289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390145.720682:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847820160 00000100:00100000:0.0:1785390145.720706:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847820160 00000100:00100000:0.0:1785390145.720773:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:0.0:1785390145.720785:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11509:x1872116847820160:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1785390145.720883:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.720904:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.720932:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729160:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729189:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729213:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729311:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729321:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729328:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390145.729388:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1785390145.729393:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390145.729409:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729422:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729430:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729447:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729454:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390145.729459:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729467:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729480:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:1.0:1785390145.729484:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390145.729489:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729619:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed834 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729635:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729641:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729646:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729650:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390145.729653:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729747:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729754:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390145.729757:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390145.729760:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729765:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed83b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729782:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729789:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729796:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729801:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390145.729804:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729810:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729816:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390145.729818:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390145.729820:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.729837:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390145.730189:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11509:x1872116847820160:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 9400us (9909us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390145.730200:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 172 00000100:00100000:1.0:1785390145.743986:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390145.744091:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847820416 00000100:00100000:3.0:1785390145.744104:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847820416 00000100:00100000:3.0:1785390145.744167:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:3.0:1785390145.744177:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11509:x1872116847820416:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390145.744203:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390145.744230:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed849 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1e7 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744366:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744382:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744394:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390145.744407:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1785390145.744867:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744876:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744884:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744890:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390145.744895:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744918:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744933:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:3.0:1785390145.744936:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390145.744942:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744949:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.744992:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed849 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e7 expref: 58 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.745003:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:3.0:1785390145.745005:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390145.745009:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed849 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e7 expref: 58 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.745020:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:3.0:1785390145.745092:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847820416:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 915us (1115us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1785390145.745101:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 173 00000100:00100000:3.0:1785390145.749877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390145.749973:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847820544 00000100:00100000:0.0:1785390145.749988:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847820544 00000100:00100000:0.0:1785390145.750059:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:0.0:1785390145.750071:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847820544:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1785390145.750112:0:5804:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1785390145.750227:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847820544:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 158us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390145.750235:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 174 00000100:00100000:2.0:1785390145.753440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390145.753545:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847820800 00000100:00100000:0.0:1785390145.753572:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847820800 00000100:00100000:0.0:1785390145.753627:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:0.0:1785390145.753637:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847820800:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390145.753655:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390145.753658:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1785390145.753684:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4800/0x33dffe75ff5ed80a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1d9 expref: 57 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.753715:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390145.753721:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390145.753734:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed85e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1ee expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785390145.754100:0:7121:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1785390145.754291:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.754305:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.754315:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.754364:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed85e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1ee expref: 59 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.754379:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1ee expref: 58 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.754399:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf50896cd00) 00010000:00010000:0.0:1785390145.754401:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390145.754404:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:0.0:1785390145.754475:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11509:x1872116847820800:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 840us (1043us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1785390145.754482:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 175 00000100:00100000:0.0:1785390145.778820:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.779024:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847821056 00000100:00100000:1.0:1785390145.779040:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847821056 00000100:00100000:1.0:1785390145.779121:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:1.0:1785390145.779136:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11509:x1872116847821056:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785390145.779218:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390145.779655:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1ee expref: 58 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.780009:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf50896cd00) 00010000:00010000:1.0:1785390145.780023:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390145.780111:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780130:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780141:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780185:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780192:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780198:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780276:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780283:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780303:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780308:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390145.780312:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780320:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780331:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390145.780334:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390145.780338:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780345:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ed873 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780357:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780363:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780368:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780373:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390145.780376:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780392:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780399:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7ddd3228 (ffff8cf50896c300) 00010000:00010000:0.0:1785390145.780402:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390145.780405:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.780409:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed87a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7ddd3228 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390145.780509:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847821056:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1375us (1695us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785390145.780518:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 176 00000100:00100000:0.0:1785390145.784006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.784097:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847821184 00000100:00100000:1.0:1785390145.784106:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847821184 00000100:00100000:1.0:1785390145.784188:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:1.0:1785390145.784197:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11509:x1872116847821184:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390145.784216:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390145.784233:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1f5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.784264:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.784285:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.784296:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.784379:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5ed881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 59 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.784396:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.784404:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390145.784407:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785390145.784410:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5c00, rc 0) 00000100:00100000:1.0:1785390145.784454:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11509:x1872116847821184:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 258us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390145.784461:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 177 00000100:00100000:3.0:1785390145.803836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.805834:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847821440 00000100:00100000:1.0:1785390145.805848:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847821440 00000100:00100000:1.0:1785390145.805932:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 178 00000100:00100000:1.0:1785390145.805943:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11509:x1872116847821440:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785390145.806028:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.806045:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.806076:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390145.806357:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1785390145.806366:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 454360841204ns, next at 455360838940ns, rc = 0 00000004:00010000:1.0:1785390145.806450:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb14d1b5 reply state 00000000fbbce7ea transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390145.806459:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390145.806591:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11509:x1872116847821440:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 649us (2769us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1785390145.806598:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 178 00010000:00010000:2.0:1785390145.819297:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.819321:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.819357:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.819365:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390145.819371:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.819381:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.819403:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:2.0:1785390145.819407:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1785390145.819414:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.819420:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5ed88f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390145.820377:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390145.820426:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847821568 00000100:00100000:3.0:1785390145.820438:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847821568 00000100:00100000:3.0:1785390145.820575:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:3.0:1785390145.820588:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11509:x1872116847821568:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390145.820620:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390145.820643:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c1fc expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.820733:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 60 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.820751:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 60 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.820774:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:3.0:1785390145.820778:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390145.820782:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:3.0:1785390145.820853:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11509:x1872116847821568:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 269us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390145.820862:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 179 00000100:00100000:1.0:1785390145.833878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390145.834044:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847821696 00000100:00100000:0.0:1785390145.834062:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847821696 00000100:00100000:0.0:1785390145.834193:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:0.0:1785390145.834205:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847821696:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1785390145.834852:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847821696:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 649us (982us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1785390145.834860:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00080000:3.0:1785390145.837394:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785390145.838391:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390145.838587:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847821952 00000100:00100000:2.0:1785390145.838599:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847821952 00000100:00100000:2.0:1785390145.838649:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1785390145.838670:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11509:x1872116847821952:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785390145.839167:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:11509:x1872116847821952:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 507us (779us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1785390145.839176:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1785390145.842169:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390145.842260:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847822208 00000100:00100000:0.0:1785390145.842272:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847822208 00000100:00100000:0.0:1785390145.842329:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:0.0:1785390145.842339:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:11509:x1872116847822208:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785390145.842499:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:11509:x1872116847822208:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390145.842508:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 180 00000100:00100000:1.0:1785390145.847360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390145.847509:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847822336 00000100:00100000:3.0:1785390145.847521:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847822336 00000100:00100000:3.0:1785390145.847627:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:3.0:1785390145.847639:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:11509:x1872116847822336:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390145.847676:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390145.847710:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed89d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c203 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.847840:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed8a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.847857:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.847871:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390145.847930:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390145.847964:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.847995:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed89d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c203 expref: 63 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.848015:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c203 expref: 62 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.848025:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:3.0:1785390145.848028:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1785390145.848033:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5200, rc 0) 00000100:00100000:3.0:1785390145.848106:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:11509:x1872116847822336:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 468us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390145.848114:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 181 00000100:00100000:3.0:1785390145.853256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390145.853465:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847822464 00000100:00100000:2.0:1785390145.853477:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847822464 00000100:00100000:2.0:1785390145.853818:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1785390145.853830:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847822464:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390145.853855:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390145.853877:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c20a expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390145.853917:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6ae441, blocks: 0x1 00010000:00010000:2.0:1785390145.853940:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1785390145.853945:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390145.853955:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 8 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.853973:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 8 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390145.853991:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121ce00, rc 0) 00000100:00100000:2.0:1785390145.854090:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847822464:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 263us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390145.854097:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1785390145.859466:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.859865:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847822720 00000100:00100000:1.0:1785390145.859877:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847822720 00000100:00100000:1.0:1785390145.859949:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:1.0:1785390145.859959:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:11509:x1872116847822720:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785390145.860082:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:11509:x1872116847822720:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 125us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390145.860089:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 182 00000100:00100000:3.0:1785390145.864307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390145.864431:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847822848 00000100:00100000:0.0:1785390145.864442:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847822848 00000100:00100000:0.0:1785390145.864508:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1785390145.864518:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:11509:x1872116847822848:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390145.864581:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390145.864604:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c211 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.864644:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 9 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.864654:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390145.864669:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390145.864676:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.864749:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 9 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390145.865389:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 9 pid: 7936 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390145.865410:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879284736:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390145.865754:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535eadf00 going to sleep for 11 seconds 00000100:00100000:1.0:1785390145.889437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.889774:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847822976 00000100:00100000:1.0:1785390145.889786:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847822976 00010000:00010000:1.0:1785390145.889836:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 10 pid: 7936 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390145.890303:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6599:1872116879284736:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390145.890399:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390145.890424:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:1.0:1785390145.891334:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1785390145.891406:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2359:x1872116847822976:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390145.891428:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390145.891469:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 10 pid: 7936 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.891486:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 10 pid: 7936 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.891514:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5ed8ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c20a expref: 10 pid: 7936 timeout: 554 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390145.891636:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:11509:x1872116847822848:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 27118us (27336us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390145.891646:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00010000:00010000:1.0:1785390145.893319:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390145.893328:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390145.893733:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.893749:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390145.893805:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390145.893824:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf511081180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1872116879284864:192.168.202.54@tcp:105: 00000100:00100000:1.0:1785390145.894793:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a258000 going to sleep for 11 seconds 00000100:00100000:1.0:1785390145.908025:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.908085:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf511081180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5788:1872116879284864:192.168.202.54@tcp:105: 00010000:00010000:1.0:1785390145.908113:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390145.908172:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847822976:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 16828us (18746us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390145.908185:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:1.0:1785390145.908784:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847823104 00000100:00100000:1.0:1785390145.908792:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847823104 00002000:00100000:1.0:1785390145.908848:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cf53a78c000 x1872116847823104/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:131/0 lens 504/0 e 0 to 0 dl 1785390156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390145.908860:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53a78c000 with x1872116847823104 ext(0->8) 00002000:00010000:1.0:1785390145.908866:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53a78c000 00000100:00100000:1.0:1785390145.908901:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:1.0:1785390145.908910:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847823104:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1785390145.910645:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2359:x1872116847823104:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 1610us (2503us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1785390145.910716:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00002000:00100000:1.0:1785390145.910726:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cf53a78c000 x1872116847823104/t4294967314(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:131/0 lens 504/448 e 0 to 0 dl 1785390156 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390145.910737:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53a78c000 with x1872116847823104 ext(0->8) 00002000:00010000:1.0:1785390145.910741:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53a78c000 00000100:00100000:3.0:1785390145.915193:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390145.915836:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847823232 00000100:00100000:1.0:1785390145.915849:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847823232 00000100:00100000:1.0:1785390145.915955:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 183 00000100:00100000:1.0:1785390145.915982:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:11509:x1872116847823232:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1785390146.007762:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785390146.014125:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1785390146.014173:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1785390146.014179:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1785390146.014206:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1785390146.014220:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1785390146.014294:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf5235cf780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1785390146.014300:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf535a49c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf5235cf3c0 00000020:00080000:0.0:1785390146.014303:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf535a49900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf53fff0000 00000100:00100000:2.0:1785390146.014840:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879284992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1785390146.015014:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390146.015209:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879284992 00000100:00100000:3.0:1785390146.015219:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879284992 00000100:00100000:3.0:1785390146.015826:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1785390146.015840:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879284992:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1785390146.016092:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1785390146.016968:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1785390146.017205:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00010000:2.0:1785390146.018033:0:7936:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785390146.018037:0:7936:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785390145 00002000:00010000:2.0:1785390146.018056:0:7936:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785390146.018058:0:7936:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1785390145 -> 1785390145 00002000:00010000:2.0:1785390146.018060:0:7936:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785390146.018120:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879284992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2282us (3104us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1785390146.018129:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1785390146.018163:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879285120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1785390146.018204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1785390146.018298:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf541d4c700/2, rc 0, transno 4294967315 00000100:00100000:2.0:1785390146.018306:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879284992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1785390146.018778:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11509:x1872116847823232:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 102794us (103592us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390146.018789:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 183 00000100:00100000:3.0:1785390146.019312:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879285120 00000100:00100000:3.0:1785390146.019319:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879285120 00000100:00100000:3.0:1785390146.019383:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1785390146.019393:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879285120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1785390146.019420:0:6597:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1785390146.019623:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a6ae43e, atime: 0x0, ctime: 0x6a6ae43e, blocks: 0xb 00010000:00010000:3.0:1785390146.019634:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.019652:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=454s v=(0 0) 00000100:00080000:0.0:1785390146.021092:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785390146.026829:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390146.026843:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.026871:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.027300:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.027309:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.028208:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785390146.029177:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879285120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9781us (10967us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1785390146.029189:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1785390146.029274:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1785390146.029282:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1785390146.029310:0:3310:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf50dcc3b80 x1872116879285120/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785390162 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1785390146.029325:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf50dcc3b80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1785390146.029331:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879285120:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785390146.032039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390146.033390:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847823360 00000100:00100000:3.0:1785390146.033405:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847823360 00000100:00100000:3.0:1785390146.033493:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:3.0:1785390146.033504:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2359:x1872116847823360:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1785390146.035913:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390146.035930:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.035946:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390146.035951:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.035963:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.035989:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.035997:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041c31b80/0x33dffe75ff5ed8b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.036033:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390146.036036:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390146.036038:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785390146.131318:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1785390146.131351:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1785390146.131363:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1785390146.131792:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847823360:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 98282us (99754us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390146.131805:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1785390146.137982:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390146.138068:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847823616 00000100:00100000:0.0:1785390146.138080:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847823616 00000100:00100000:0.0:1785390146.138146:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 184 00000100:00100000:0.0:1785390146.138156:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11509:x1872116847823616:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1785390146.138234:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390146.138267:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed8a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c203 expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.138289:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:0.0:1785390146.138295:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390146.138331:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.138428:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.138462:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390146.138783:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0ae95bc reply state 000000007bf0f488 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390146.138794:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1785390146.139389:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11509:x1872116847823616:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1232us (1416us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1785390146.139396:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 184 00010000:00010000:2.0:1785390146.144037:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.144058:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.144067:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.144074:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390146.144080:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.144089:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.144108:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:2.0:1785390146.144112:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390146.144126:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.144132:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ed8c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390146.144245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390146.146791:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847823744 00000100:00100000:2.0:1785390146.146806:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847823744 00000100:00100000:2.0:1785390146.146893:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:2.0:1785390146.146907:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847823744:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785390146.147255:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1785390146.147260:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1785390145 -> 1785390144 00002000:00010000:2.0:1785390146.147262:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785390142 00002000:00010000:2.0:1785390146.147265:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1785390145 -> 1785390144 00002000:00010000:2.0:1785390146.147267:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1785390146.147658:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847823744:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 437us (3100us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1785390146.147669:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000040:00080000:1.0:1785390146.168733:0:12383:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785390146.168745:0:12383:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785390146.168805:0:12383:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1785390146.168813:0:12383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785390146.175799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390146.176317:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824000 00000100:00100000:3.0:1785390146.176331:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824000 00000100:00100000:3.0:1785390146.176408:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:3.0:1785390146.176420:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11509:x1872116847824000:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1785390146.176545:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.176565:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.176575:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.176618:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.176635:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 18 pid: 5803 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390146.176651:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50698b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879285248:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390146.176772:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7480 going to sleep for 11 seconds 00000100:00100000:2.0:1785390146.181832:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390146.181938:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50698b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879285248:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390146.181980:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.182653:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824128 00000100:00100000:1.0:1785390146.182663:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824128 00010000:00010000:1.0:1785390146.182720:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 19 pid: 5803 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.182763:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:1.0:1785390146.182772:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:2359:x1872116847824128:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390146.182789:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390146.182797:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 19 pid: 5803 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.182811:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 19 pid: 5803 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.182837:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ed888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1f5 expref: 19 pid: 5803 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.182856:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390146.182861:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.182894:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.182903:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.182926:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390146.182989:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2359:x1872116847824128:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 217us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390146.182997:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00010000:00010000:2.0:1785390146.183841:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183851:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183897:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183905:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183920:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183926:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390146.183930:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183938:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183951:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:2.0:1785390146.183954:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1785390146.183958:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.183964:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed8c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390146.184022:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:11509:x1872116847824000:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 7604us (8236us total) trans 0 rc -22/-22 00000100:00100000:2.0:1785390146.184029:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 185 00000100:00100000:2.0:1785390146.188282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390146.188361:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824256 00000100:00100000:1.0:1785390146.188372:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824256 00000100:00100000:1.0:1785390146.188433:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:1.0:1785390146.188453:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847824256:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785390146.188509:0:7936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.188572:0:7936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.188583:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390146.188587:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390146.188592:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.188636:0:7936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.188666:0:7936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 8 pid: 6599 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.188694:0:7936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7936:1872116879285376:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390146.188794:0:7936:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508ea9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785390146.191288:0:7936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7936:1872116879285376:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390146.191321:0:7936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390146.192570:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390146.192835:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824384 00000100:00100000:1.0:1785390146.192845:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824384 00010000:00010000:1.0:1785390146.192900:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 9 pid: 6599 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.192949:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:1.0:1785390146.192960:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2359:x1872116847824384:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390146.192978:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390146.193006:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 9 pid: 6599 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.193020:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 9 pid: 6599 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.193047:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5ed8b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c211 expref: 9 pid: 6599 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.193066:0:11040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390146.193070:0:11040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390146.193086:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.193097:0:11040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.193126:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390146.193184:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847824384:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 225us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390146.193192:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00010000:00010000:3.0:1785390146.193569:0:7936:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193581:0:7936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193625:0:7936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193634:0:7936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193643:0:7936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193651:0:7936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390146.193656:0:7936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193666:0:7936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193679:0:7936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.193698:0:7936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5ed8ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390146.193759:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847824256:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 5317us (5486us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390146.193768:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1785390146.203636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390146.203813:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824640 00000100:00100000:0.0:1785390146.203826:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824640 00000100:00100000:0.0:1785390146.203904:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 186 00000100:00100000:0.0:1785390146.203916:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+17:11509:x1872116847824640:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1785390146.204024:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204045:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204059:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204314:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204326:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204474:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204515:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 18 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.204606:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 18 pid: 7121 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390146.204622:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879285504:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390146.204750:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390146.226184:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390146.226584:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824768 00000100:00100000:1.0:1785390146.226596:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824768 00010000:00010000:1.0:1785390146.226648:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 19 pid: 7121 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.226705:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:1.0:1785390146.226716:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:2359:x1872116847824768:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390146.226734:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390146.226742:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 19 pid: 7121 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.226758:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 19 pid: 7121 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.226784:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390146.226791:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.226812:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.226821:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.226842:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390146.226910:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:2359:x1872116847824768:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 195us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390146.226919:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00010000:00010000:0.0:1785390146.228792:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed896 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1fc expref: 18 pid: 7121 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390146.228813:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879285504:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390146.228839:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.228848:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.228854:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1785390146.229061:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1785390146.229221:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1785390146.229263:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1785390146.229358:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1872116879285632:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785390146.229423:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390146.229461:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51833e300 going to sleep for 11 seconds 00000100:00100000:1.0:1785390146.230625:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879285632 00000100:00100000:1.0:1785390146.230637:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879285632 00000100:00100000:1.0:1785390146.230710:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785390146.230722:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5802:x1872116879285632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785390146.230824:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5802:x1872116879285632:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390146.230832:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1785390146.232323:0:5802:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1785390146.232332:0:5802:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf541d4c700, transno 4294967315 00000100:00100000:0.0:1785390146.232363:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1872116879285632:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1785390146.233000:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1785390146.233089:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50dcc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1872116879285760:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1785390146.233144:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390146.233176:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5110713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390146.235747:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879285760 00000100:00100000:1.0:1785390146.235767:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879285760 00000100:00100000:1.0:1785390146.235835:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785390146.235847:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5802:x1872116879285760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1785390146.237466:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5802:x1872116879285760:12345-0@lo:1000:mdt00_000.0 Request processed in 1615us (4315us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1785390146.237478:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785390146.237577:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50dcc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1872116879285760:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1785390146.237633:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237662:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237670:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237677:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390146.237693:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237703:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237721:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390146.237724:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390146.237729:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237735:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed8dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237774:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237780:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237786:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237790:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390146.237799:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237805:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237814:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390146.237817:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390146.237820:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237827:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ed811 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237854:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237870:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237892:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237935:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.237966:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 21 pid: 5802 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.237982:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a78c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879285888:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390146.238074:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508ea9480 going to sleep for 11 seconds 00000100:00100000:3.0:1785390146.248219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390146.248259:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847824896 00000100:00100000:3.0:1785390146.248269:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847824896 00010000:00010000:3.0:1785390146.248313:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 22 pid: 5802 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390146.248663:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:3.0:1785390146.248674:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:2360:x1872116847824896:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390146.248701:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390146.248709:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 22 pid: 5802 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.248723:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 22 pid: 5802 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.248749:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:3.0:1785390146.248755:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.248765:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.248773:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390146.248799:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390146.248855:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:2360:x1872116847824896:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 183us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390146.248870:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00010000:00010000:1.0:1785390146.250374:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5ed82d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c1e0 expref: 21 pid: 5802 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.250395:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a78c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879285888:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390146.250422:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250432:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250439:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250461:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250468:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250476:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250483:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390146.250488:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250496:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250510:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390146.250512:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390146.250547:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250555:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed8e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250567:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250574:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250580:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250586:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390146.250589:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250594:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250603:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf510c5a300) 00010000:00010000:1.0:1785390146.250605:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785390146.250608:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390146.250614:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed8d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390146.250894:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11509:x1872116847824640:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 46979us (47268us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1785390146.250905:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 186 00000020:00080000:1.0:1785390146.250916:0:5802:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1785390146.253651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390146.253731:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847825152 00000100:00100000:2.0:1785390146.253752:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847825152 00000100:00100000:2.0:1785390146.253808:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1785390146.253820:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508786850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11509:x1872116847825152:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1785390146.255332:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785390146.255774:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785390146.256896:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1785390146.256908:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:2.0:1785390146.258045:0:5805:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1785390146.258154:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1785390146.258234:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.258253:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.258267:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.258276:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.258283:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.258290:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390146.258318:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390146.258546:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390146.258555:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.258562:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390146.258567:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.258575:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.258589:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf50629b200) 00010000:00010000:0.0:1785390146.258592:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785390146.258598:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.258605:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed8ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390146.258651:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390146.258653:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390146.258655:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390146.260790:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508786850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:11509:x1872116847825152:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 6963us (7141us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1785390146.260805:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000020:00080000:2.0:1785390146.260812:0:5805:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1785390146.582135:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879286144:0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.582234:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390146.582294:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879286656:0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.582323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390146.582362:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1785390146.582368:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879286016:0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.582401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390146.582417:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879286528:0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.582436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390146.582474:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286656 00000100:00100000:1.0:1785390146.582481:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286656 00000100:00100000:1.0:1785390146.582652:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785390146.582664:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879286656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.582737:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879286656:12345-0@lo:400:kworker.0 Request processed in 74us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390146.582745:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1785390146.582776:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286144 00000100:00100000:1.0:1785390146.582780:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286144 00000100:00100000:1.0:1785390146.582804:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286528 00000100:00100000:1.0:1785390146.582807:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286528 00000100:00100000:1.0:1785390146.582840:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1785390146.582846:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879286144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390146.582969:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1785390146.582980:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53591aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879286528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390146.583039:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53591aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879286528:12345-0@lo:400:kworker.0 Request processed in 62us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390146.583046:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1785390146.583193:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879286144:12345-0@lo:400:kworker.0 Request processed in 346us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390146.583200:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1785390146.583226:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390146.583275:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879286528:0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.583289:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879286144:0@lo:400:kworker.0 00000100:00100000:1.0:1785390146.583299:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879286656:0@lo:400:kworker.0 00000100:00100000:3.0:1785390146.583395:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879286272:0@lo:400:kworker.0 00000100:00100000:3.0:1785390146.583430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390146.583467:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785390146.583474:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879286400:0@lo:400:kworker.0 00000100:00100000:3.0:1785390146.583499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390146.583671:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286016 00000100:00100000:3.0:1785390146.583677:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286016 00000100:00100000:3.0:1785390146.583718:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1785390146.583726:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879286016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390146.583761:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879286016:12345-0@lo:400:kworker.0 Request processed in 37us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390146.583765:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1785390146.583836:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286400 00000100:00100000:0.0:1785390146.583841:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286400 00000100:00100000:0.0:1785390146.583868:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1785390146.583880:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879286400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390146.583910:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1872116879286400:12345-0@lo:400:kworker.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390146.583915:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1785390146.584021:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879286400:0@lo:400:kworker.0 00000100:00100000:2.0:1785390146.584065:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286272 00000100:00100000:2.0:1785390146.584068:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286272 00000100:00100000:2.0:1785390146.584103:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1785390146.584107:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390146.584143:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879286272:12345-0@lo:400:kworker.0 Request processed in 35us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390146.584149:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1785390146.584268:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879286016:0@lo:400:kworker.0 00000100:00100000:3.0:1785390146.584329:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879286272:0@lo:400:kworker.0 00000100:00080000:0.0:1785390146.584384:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1785390147.029768:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390147.093950:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785390147.093979:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879286784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390147.094069:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390147.094257:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286784 00000100:00100000:2.0:1785390147.094267:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286784 00000100:00100000:2.0:1785390147.094325:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785390147.094335:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879286784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390147.094376:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1785390147.094441:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879286784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390147.094449:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1785390147.094664:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879286784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390147.618687:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf506989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879286912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390147.618785:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390147.619658:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879286912 00000100:00100000:0.0:1785390147.619678:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879286912 00000100:00100000:0.0:1785390147.619741:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1785390147.619752:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879286912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390147.619799:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390147.619856:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879286912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390147.620987:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf506989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879286912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390147.621519:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:0.0:1785390148.053772:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1785390148.242150:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:2.0:1785390148.708988:0:12435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1785390148.708997:0:12435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390148.709030:0:12435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1785390148.709036:0:12435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785390148.968644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390148.968722:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847825408 00000100:00100000:2.0:1785390148.968733:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847825408 00000100:00100000:2.0:1785390148.968807:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 187 00000100:00100000:2.0:1785390148.968818:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:11528:x1872116847825408:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390148.968855:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390148.968876:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed8f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c218 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.969134:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed8f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.969148:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.969161:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390148.969172:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1785390148.969343:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed8f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c218 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.969359:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c218 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.969366:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390148.969369:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785390148.969372:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c200, rc 0) 00000100:00100000:2.0:1785390148.969421:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11528:x1872116847825408:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 606us (785us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1785390148.969427:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 187 00000100:00080000:0.0:1785390148.969698:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390148.974221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390148.974354:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847825536 00000100:00100000:2.0:1785390148.974363:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847825536 00000100:00100000:2.0:1785390148.974414:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:2.0:1785390148.974437:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11528:x1872116847825536:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1785390148.974503:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974517:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974552:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974566:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974574:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974579:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974868:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974877:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974884:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390148.974923:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974935:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974948:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974954:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974961:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390148.974966:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974973:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974985:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390148.974988:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390148.974992:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.974999:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975011:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975017:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975023:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975027:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390148.975037:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975043:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975051:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50629b400) 00010000:00010000:2.0:1785390148.975054:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390148.975057:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975062:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed90d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975189:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975196:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975202:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975207:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390148.975210:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975216:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975223:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629bf00) 00010000:00010000:2.0:1785390148.975226:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390148.975234:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390148.975240:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390148.975361:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11528:x1872116847825536:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 925us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390148.975369:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 188 00000100:00100000:2.0:1785390149.048632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.048677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.048707:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.048728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.048750:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847825664 00000100:00100000:2.0:1785390149.048758:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847825664 00000100:00100000:2.0:1785390149.048798:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 320 00000100:00100000:2.0:1785390149.048807:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847825664:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390149.048868:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2360:x1872116847825664:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390149.048897:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 320 00000100:00100000:2.0:1785390149.048941:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847825792 00000100:00100000:2.0:1785390149.048945:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847825792 00000100:00100000:2.0:1785390149.048978:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847825920 00000100:00100000:3.0:1785390149.048982:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847826048 00000100:00100000:2.0:1785390149.048982:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847825920 00000100:00100000:3.0:1785390149.048986:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847826048 00000100:00100000:2.0:1785390149.049002:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1785390149.049008:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847825792:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390149.049012:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:3.0:1785390149.049018:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2360:x1872116847826048:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390149.049037:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2360:x1872116847825792:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390149.049041:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2360:x1872116847826048:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390149.049056:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:2.0:1785390149.049056:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 122 00000100:00100000:2.0:1785390149.049068:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00100000:2.0:1785390149.049074:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847825920:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390149.049095:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847825920:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390149.049101:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 123 00000100:00080000:2.0:1785390149.049117:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1785390149.049121:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390149.049123:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1785390149.081168:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390149.106245:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.106310:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847826304 00000100:00100000:2.0:1785390149.106320:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847826304 00000100:00100000:2.0:1785390149.106374:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:2.0:1785390149.106384:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11531:x1872116847826304:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390149.106405:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390149.106433:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed91b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c21f expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.106495:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.106508:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.106519:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.106553:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.106567:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.106573:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108002:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108012:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108020:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390149.108029:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1785390149.108115:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108122:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108128:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108133:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390149.108137:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108143:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108164:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390149.108167:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390149.108172:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108177:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108188:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108194:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108200:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108204:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390149.108206:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108212:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108219:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50629bf00) 00010000:00010000:2.0:1785390149.108221:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390149.108223:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108228:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed929 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108288:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ed91b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 27 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108301:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 26 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.108309:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:2.0:1785390149.108311:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390149.108314:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c000, rc 0) 00000100:00100000:2.0:1785390149.108377:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11531:x1872116847826304:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1995us (2140us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1785390149.108385:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 189 00000100:00100000:2.0:1785390149.124199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390149.129734:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847826432 00000100:00100000:1.0:1785390149.129749:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847826432 00000100:00100000:1.0:1785390149.129815:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:1.0:1785390149.129826:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11531:x1872116847826432:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1785390149.129896:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.129913:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.129925:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.129969:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.129976:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.129982:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.129988:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390149.129992:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.130000:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.130012:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:1.0:1785390149.130015:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390149.130019:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.130026:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed93e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.130101:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11531:x1872116847826432:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 276us (5911us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390149.130109:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 190 00000100:00100000:0.0:1785390149.146737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.146808:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847826688 00000100:00100000:2.0:1785390149.146818:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847826688 00000100:00100000:2.0:1785390149.146873:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1785390149.146883:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11531:x1872116847826688:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1785390149.147119:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:11531:x1872116847826688:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 236us (391us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1785390149.147126:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:1.0:1785390149.219692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.219782:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847826944 00000100:00100000:3.0:1785390149.219792:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847826944 00000100:00100000:3.0:1785390149.219850:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:3.0:1785390149.219859:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:11056:x1872116847826944:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390149.219882:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390149.219903:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed945 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c226 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.219994:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.220006:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 28 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.220013:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.220041:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 28 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.220052:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 28 pid: 7121 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390149.220063:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879287040:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390149.220152:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1785390149.226275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390149.226340:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847827072 00000100:00100000:1.0:1785390149.226349:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847827072 00010000:00010000:1.0:1785390149.226397:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 29 pid: 7121 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.226441:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:1.0:1785390149.226450:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:2360:x1872116847827072:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390149.226464:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390149.226472:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 29 pid: 7121 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.226484:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 29 pid: 7121 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.226504:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:1.0:1785390149.226508:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.226517:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.226560:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.226577:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390149.226627:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:2360:x1872116847827072:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 179us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390149.226634:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00010000:00010000:3.0:1785390149.227055:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ed930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c21f expref: 28 pid: 7121 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390149.227076:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf506988000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879287040:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390149.227099:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.227109:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.227115:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390149.227132:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1785390149.227268:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed945 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.227283:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 28 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.227290:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:3.0:1785390149.227292:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785390149.227295:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4800, rc 0) 00000100:00100000:3.0:1785390149.227336:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:11056:x1872116847826944:12345-192.168.202.54@tcp:101:bash.0 Request processed in 7478us (7651us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1785390149.227343:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 191 00000100:00100000:0.0:1785390149.235245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390149.235335:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847827328 00000100:00100000:1.0:1785390149.235346:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847827328 00000100:00100000:1.0:1785390149.235397:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 192 00000100:00100000:1.0:1785390149.235421:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:11056:x1872116847827328:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:1.0:1785390149.235728:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.235745:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.235756:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390149.235809:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1785390149.235837:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000051b91c8e reply state 0000000016778d13 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.235845:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1785390149.236128:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1785390149.236228:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11056:x1872116847827328:12345-192.168.202.54@tcp:36:bash.0 Request processed in 808us (991us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1785390149.236242:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 192 00000020:00080000:0.0:1785390149.236247:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1785390149.243394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.243468:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847827456 00000100:00100000:3.0:1785390149.243477:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847827456 00000100:00100000:3.0:1785390149.243557:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 193 00000100:00100000:3.0:1785390149.243567:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11056:x1872116847827456:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390149.243604:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390149.243624:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed961 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c22d expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.243690:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c22d expref: 33 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.243705:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c22d expref: 33 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.243722:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:3.0:1785390149.243725:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390149.243729:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785390149.243776:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+33:11056:x1872116847827456:12345-192.168.202.54@tcp:101:bash.0 Request processed in 206us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390149.243783:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 193 00010000:00010000:2.0:1785390149.243863:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.243871:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.243886:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.243899:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390149.243903:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.243911:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.243923:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:2.0:1785390149.243925:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390149.243928:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.243935:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ed95a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.257163:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.257256:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847827584 00000100:00100000:2.0:1785390149.257265:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847827584 00000100:00100000:2.0:1785390149.257329:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1785390149.257338:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:11056:x1872116847827584:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390149.257356:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390149.257375:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c234 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390149.257400:0:6597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a6ae440, atime: 0x6a6ae43e, ctime: 0x6a6ae440, blocks: 0xb 00010000:00010000:2.0:1785390149.257418:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1785390149.257422:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390149.257428:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.257460:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.257472:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d200, rc 0) 00000100:00100000:2.0:1785390149.257564:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:11056:x1872116847827584:12345-192.168.202.54@tcp:101:bash.0 Request processed in 227us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390149.257572:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:0.0:1785390149.263049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.263137:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847827712 00000100:00100000:2.0:1785390149.263152:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847827712 00002000:00010000:2.0:1785390149.263195:0:6602:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1785390149.263200:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50dcc2300 with x1872116847827712 ext(0->18446744073709551615) 00002000:00010000:2.0:1785390149.263212:0:6602:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50dcc2300. 00000100:00100000:2.0:1785390149.263261:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1785390149.263286:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847827712:12345-192.168.202.54@tcp:10:bash.0 00002000:00010000:2.0:1785390149.263568:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1785390149.263572:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1785390144 -> 1785390149 00002000:00010000:2.0:1785390149.263574:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1785390142 -> 1785390142 00002000:00010000:2.0:1785390149.263576:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1785390144 -> 1785390149 00002000:00010000:2.0:1785390149.263578:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1785390149.263652:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2359:x1872116847827712:12345-192.168.202.54@tcp:10:bash.0 Request processed in 366us (598us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1785390149.263680:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00002000:00010000:2.0:1785390149.263683:0:6602:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1785390149.263686:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50dcc2300 with x1872116847827712 ext(0->18446744073709551615) 00002000:00010000:2.0:1785390149.263701:0:6602:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50dcc2300. 00000100:00100000:1.0:1785390149.392818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.392933:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847827840 00000100:00100000:2.0:1785390149.392943:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847827840 00000100:00100000:2.0:1785390149.393005:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:2.0:1785390149.393016:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11545:x1872116847827840:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1785390149.393088:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393106:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393117:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393132:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393139:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393145:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393436:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393445:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393452:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390149.393504:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393515:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393564:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393572:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393578:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390149.393582:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393589:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393600:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390149.393603:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390149.393606:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393612:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ed96f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393623:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393627:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393639:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393644:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390149.393646:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393652:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393672:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50629b700) 00010000:00010000:2.0:1785390149.393674:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390149.393677:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393682:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5ed976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393707:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393712:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393717:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393722:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390149.393725:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393740:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393749:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:2.0:1785390149.393751:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390149.393754:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.393760:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390149.393825:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11545:x1872116847827840:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 810us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390149.393833:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 194 00000100:00100000:1.0:1785390149.479290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.479379:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847828096 00000100:00100000:3.0:1785390149.479392:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847828096 00000100:00100000:3.0:1785390149.479463:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:3.0:1785390149.479473:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+32:11548:x1872116847828096:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390149.479501:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390149.479560:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c23b expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.479652:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.479678:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.479711:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.479728:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.479735:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.479742:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480135:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480143:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480151:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390149.480163:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1785390149.480281:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480289:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480297:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480303:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390149.480314:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480323:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480337:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390149.480340:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390149.480345:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480352:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed98b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480365:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480371:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480376:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480381:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390149.480384:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480389:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480395:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390149.480397:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390149.480407:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480413:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480454:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c23b expref: 35 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480467:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c23b expref: 34 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.480474:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:3.0:1785390149.480477:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1785390149.480479:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5200, rc 0) 00000100:00100000:3.0:1785390149.480591:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:11548:x1872116847828096:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1119us (1313us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1785390149.480600:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 195 00000100:00100000:1.0:1785390149.488175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.488288:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847828224 00000100:00100000:2.0:1785390149.488300:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847828224 00000100:00100000:2.0:1785390149.488379:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:2.0:1785390149.488392:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:11548:x1872116847828224:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:2.0:1785390149.488490:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.488509:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.488519:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.488578:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.488614:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 34 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390149.488630:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879287168:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390149.488757:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f3e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390149.508356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.508509:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847828480 00000100:00100000:3.0:1785390149.508561:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847828480 00000100:00100000:3.0:1785390149.508634:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:3.0:1785390149.508646:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:5580:x1872116847828480:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1785390149.509071:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:5580:x1872116847828480:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 427us (727us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1785390149.509079:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1785390149.510098:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1872116879287168:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390149.510140:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.517242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.517386:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847828608 00000100:00100000:3.0:1785390149.517397:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847828608 00010000:00010000:3.0:1785390149.517453:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 36 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390149.517517:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 75 00000100:00100000:3.0:1785390149.517565:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e068450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:2359:x1872116847828608:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390149.517585:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390149.517593:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 36 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.517608:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 36 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.517633:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed94c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c226 expref: 36 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.517663:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:3.0:1785390149.517670:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.517681:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.517689:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.517731:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390149.517996:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e068450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:2359:x1872116847828608:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 469us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390149.518005:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 75 00010000:00010000:1.0:1785390149.518502:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518512:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518570:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518579:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518598:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518604:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390149.518609:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518617:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518627:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:1.0:1785390149.518630:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390149.518634:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.518640:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5ed9a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.518705:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:11548:x1872116847828224:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 30316us (30544us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390149.518713:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 196 00000100:00100000:1.0:1785390149.537193:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.537357:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847828864 00000100:00100000:3.0:1785390149.537395:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847828864 00000100:00100000:3.0:1785390149.537463:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:3.0:1785390149.537474:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+34:11548:x1872116847828864:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390149.537809:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:11548:x1872116847828864:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 336us (627us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1785390149.537817:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:0.0:1785390149.742048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.743255:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847829120 00000100:00100000:3.0:1785390149.743269:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847829120 00000100:00100000:3.0:1785390149.743344:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 197 00000100:00100000:3.0:1785390149.743354:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+35:11559:x1872116847829120:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:3.0:1785390149.743392:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390149.743424:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed9ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c242 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.743508:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.743559:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.743572:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.743587:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.743593:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.743598:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744497:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed9c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744508:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744623:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed9c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390149.744636:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1785390149.744753:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744761:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744768:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744783:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390149.744788:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744797:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744812:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390149.744814:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390149.744819:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744835:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.744999:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745006:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745011:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745015:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390149.745018:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745023:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745030:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390149.745032:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390149.745035:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745040:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745089:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed9ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c242 expref: 38 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745103:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed9c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c242 expref: 37 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.745116:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:3.0:1785390149.745118:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390149.745121:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:3.0:1785390149.745346:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+37:11559:x1872116847829120:12345-192.168.202.54@tcp:101:cat.0 Request processed in 1992us (3309us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1785390149.745355:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 197 00000100:00100000:0.0:1785390149.757804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.757965:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847829376 00000100:00100000:3.0:1785390149.757977:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847829376 00000100:00100000:3.0:1785390149.758036:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:3.0:1785390149.758046:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+37:11559:x1872116847829376:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:3.0:1785390149.758357:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:11559:x1872116847829376:12345-192.168.202.54@tcp:35:cat.0 Request processed in 311us (565us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1785390149.758364:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:1.0:1785390149.810606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390149.810760:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847829632 00000100:00100000:0.0:1785390149.810771:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847829632 00000100:00100000:0.0:1785390149.810851:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 198 00000100:00100000:0.0:1785390149.810863:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:11560:x1872116847829632:12345-192.168.202.54@tcp:36:rm.0 00010000:00010000:0.0:1785390149.810958:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1785390149.810990:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5ed9c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c242 expref: 38 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811015:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5ed999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c23b expref: 37 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811029:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5ed961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c22d expref: 36 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811040:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50629b400) 00010000:00010000:0.0:1785390149.811064:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1785390149.811089:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811105:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811123:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811296:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811306:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811314:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811702:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811710:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.811717:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785390149.812508:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1785390149.812518:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 458366993588ns, next at 459366990693ns, rc = 0 00010000:00010000:0.0:1785390149.812608:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812618:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812627:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812645:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812661:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812668:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812705:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390149.812727:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812734:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812741:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812747:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390149.812752:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812760:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812770:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50896c300) 00010000:00010000:0.0:1785390149.812773:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1785390149.812778:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812795:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5ed9df lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812812:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812819:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812825:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812830:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390149.812834:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812840:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812860:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390149.812863:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390149.812867:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.812873:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5ed9d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390149.812883:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de412809 reply state 000000003465b158 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390149.812893:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785390149.813855:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390149.813864:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.813871:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390149.813874:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.813881:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.813890:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf50896c300) 00010000:00010000:2.0:1785390149.813892:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1785390149.813896:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.813902:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5ed9e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.813933:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390149.813935:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390149.813937:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390149.814344:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+37:11560:x1872116847829632:12345-192.168.202.54@tcp:36:rm.0 Request processed in 3479us (3745us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1785390149.814353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 198 00010000:00010000:0.0:1785390149.821991:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.822015:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.822024:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.822031:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390149.822037:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.822045:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.822064:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50896ce00) 00010000:00010000:0.0:1785390149.822067:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390149.822072:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.822078:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5ed9d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.864449:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390149.865049:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847829888 00000100:00100000:3.0:1785390149.865063:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847829888 00000100:00100000:3.0:1785390149.865239:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:3.0:1785390149.865253:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+36:11565:x1872116847829888:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390149.865302:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390149.865330:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed9ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c249 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.865496:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.865514:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.865586:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.865605:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.865612:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.865619:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785390149.866339:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1785390149.866514:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866551:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866561:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866598:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866605:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866611:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866616:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390149.866628:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866636:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866648:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390149.866662:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390149.866667:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866673:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5ed9f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1785390149.866685:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb7ff970 reply state 000000001d2fe411 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390149.866693:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1785390149.866722:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5ed9ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866736:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.866743:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:3.0:1785390149.866745:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390149.866747:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4c00, rc 0) 00000100:00100000:3.0:1785390149.866832:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11565:x1872116847829888:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1584us (2395us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1785390149.866839:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 199 00000100:00100000:2.0:1785390149.873755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390149.873851:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847830016 00000100:00100000:0.0:1785390149.873863:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847830016 00000100:00100000:0.0:1785390149.873934:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1785390149.873947:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847830016:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:0.0:1785390149.873995:0:7936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390149.874020:0:7936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c250 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390149.874054:0:7936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785390149.874078:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1785390149.874083:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390149.874095:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 6 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.874117:0:7936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 6 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390149.874133:0:7936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717400, rc 0) 00000100:00100000:0.0:1785390149.874212:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2357:x1872116847830016:12345-192.168.202.54@tcp:101:bash.0 Request processed in 268us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390149.874221:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00010000:00010000:3.0:1785390149.877947:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.877977:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.877986:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.877993:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390149.877999:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.878008:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.878156:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf520a1d800) 00010000:00010000:3.0:1785390149.878160:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390149.878167:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390149.878174:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5ed9fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390149.879320:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390149.879454:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847830144 00000100:00100000:2.0:1785390149.879467:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847830144 00000100:00100000:2.0:1785390149.879551:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1785390149.879563:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:11565:x1872116847830144:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390149.879583:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390149.879604:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c257 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.879641:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.879661:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390149.879666:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390149.879671:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.879714:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 7 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.879730:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 7 pid: 7936 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390149.879772:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879287296:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390149.879895:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f3e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390149.894126:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390149.894392:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847830272 00000100:00100000:1.0:1785390149.894405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847830272 00010000:00010000:1.0:1785390149.894453:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 8 pid: 7936 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.894594:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:1.0:1785390149.894606:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847830272:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390149.894624:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390149.894663:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 8 pid: 7936 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.894679:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 8 pid: 7936 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.894708:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390149.894712:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390149.894722:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.894733:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390149.894779:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390149.894797:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879287424:192.168.202.54@tcp:105: 00000100:00100000:1.0:1785390149.894901:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdc00 going to sleep for 11 seconds 00010000:00010000:2.0:1785390149.898339:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc54115a/0x33dffe75ff5eda10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c250 expref: 8 pid: 7936 timeout: 558 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390149.898365:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6597:1872116879287296:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390149.898402:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 7 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390149.898421:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121de00, rc 0) 00000100:00100000:2.0:1785390149.898483:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:11565:x1872116847830144:12345-192.168.202.54@tcp:101:bash.0 Request processed in 18921us (19167us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390149.898493:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1785390149.909358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390149.909385:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5789:1872116879287424:192.168.202.54@tcp:105: 00010000:00010000:1.0:1785390149.909444:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390149.909507:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847830272:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 14903us (15392us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390149.909551:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:3.0:1785390149.911315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847830528 00000100:00100000:3.0:1785390149.911328:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847830528 00000100:00100000:3.0:1785390149.911394:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1785390149.911406:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+38:11565:x1872116847830528:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1785390149.912993:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11565:x1872116847830528:12345-192.168.202.54@tcp:35:bash.0 Request processed in 1584us (3641us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1785390149.913003:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00010000:00010000:2.0:1785390150.101726:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390150.166209:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390150.166507:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847830656 00000100:00100000:1.0:1785390150.166520:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847830656 00000100:00100000:1.0:1785390150.166630:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00100000:1.0:1785390150.166643:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+39:11582:x1872116847830656:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390150.166688:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390150.166716:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5eda1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c25e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.166803:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5eda25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.166820:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5eda25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.166834:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5eda25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390150.166921:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1785390150.166926:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390150.166951:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5eda25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.166979:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5eda1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c25e expref: 41 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.167000:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5eda25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c25e expref: 40 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.167026:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390150.167029:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390150.167033:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5000, rc 0) 00000100:00100000:1.0:1785390150.167111:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:11582:x1872116847830656:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 471us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390150.167119:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 200 00000100:00080000:2.0:1785390150.167179:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390150.175593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.175694:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847830912 00000100:00100000:2.0:1785390150.175705:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847830912 00000100:00100000:2.0:1785390150.175768:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:2.0:1785390150.175779:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+40:11582:x1872116847830912:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390150.175807:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390150.175832:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c265 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.175991:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5eda33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.176008:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5eda33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.176021:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5eda33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390150.176033:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1785390150.176198:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c265 expref: 43 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.176219:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5eda33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c265 expref: 42 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.176229:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:2.0:1785390150.176232:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390150.176236:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c400, rc 0) 00000100:00100000:2.0:1785390150.176305:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:11582:x1872116847830912:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 528us (723us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1785390150.176312:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 201 00000100:00100000:3.0:1785390150.180656:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390150.180727:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847831168 00000100:00100000:1.0:1785390150.180738:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847831168 00000100:00100000:1.0:1785390150.180793:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:1.0:1785390150.180804:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50698a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+42:11582:x1872116847831168:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390150.180838:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390150.180859:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5eda41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c26c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.180967:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4400/0x33dffe75ff5eda48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.180983:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4400/0x33dffe75ff5eda48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.180994:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4400/0x33dffe75ff5eda48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390150.181007:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1785390150.181124:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5eda41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c26c expref: 45 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.181164:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4400/0x33dffe75ff5eda48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c26c expref: 44 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.181173:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:1.0:1785390150.181177:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1785390150.181181:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4400, rc 0) 00000100:00100000:1.0:1785390150.181245:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50698a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:11582:x1872116847831168:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 443us (606us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1785390150.181254:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 202 00000100:00100000:0.0:1785390150.188130:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.188317:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847831296 00000100:00100000:3.0:1785390150.188329:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847831296 00000100:00100000:3.0:1785390150.188403:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:3.0:1785390150.188420:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+44:2359:x1872116847831296:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390150.188439:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390150.188468:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5eda33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c265 expref: 44 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.188490:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:3.0:1785390150.188496:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390150.188599:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:2359:x1872116847831296:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 180us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.188608:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390150.195905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.196002:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847831424 00000100:00100000:2.0:1785390150.196015:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847831424 00000100:00100000:2.0:1785390150.196088:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:2.0:1785390150.196099:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847831424:12345-192.168.202.54@tcp:1:lfs.0 00010000:00010000:2.0:1785390150.196165:0:7936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.196212:0:7936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.196221:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390150.196225:0:7936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390150.196230:0:7936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.196269:0:7936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 6 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.196283:0:7936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 6 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390150.196299:0:7936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7936:1872116879287552:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390150.196403:0:7936:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f3e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390150.201946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.202104:0:7936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7936:1872116879287552:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390150.202147:0:7936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390150.202414:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847831552 00000100:00100000:1.0:1785390150.202424:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847831552 00002000:00100000:1.0:1785390150.202483:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cf53fdfd500 x1872116847831552/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:136/0 lens 504/0 e 0 to 0 dl 1785390161 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390150.202492:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fdfd500 with x1872116847831552 ext(0->8) 00010000:00010000:1.0:1785390150.202501:0:6604:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 7 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.202515:0:6604:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 7 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785390150.202563:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cf53fdfd500 00000100:00100000:1.0:1785390150.202596:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1785390150.202606:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847831552:12345-192.168.202.54@tcp:4:lfs.0 00000100:00100000:1.0:1785390150.203216:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2360:x1872116847831552:12345-192.168.202.54@tcp:4:lfs.0 Request processed in 610us (1280us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1785390150.203231:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00002000:00100000:1.0:1785390150.203239:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cf53fdfd500 x1872116847831552/t4294967308(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:136/0 lens 504/448 e 0 to 0 dl 1785390161 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390150.203248:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fdfd500 with x1872116847831552 ext(0->8) 00010000:00010000:1.0:1785390150.203255:0:6604:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 9 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.203279:0:6604:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 9 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1785390150.203287:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8cf53fdfd500 00000100:00100000:3.0:1785390150.211245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.211438:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847831680 00000100:00100000:2.0:1785390150.211450:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847831680 00010000:00010000:2.0:1785390150.211499:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 9 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390150.211615:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1785390150.211624:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2357:x1872116847831680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390150.211642:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1785390150.211676:0:5790:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1785390150.211679:0:5790:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1785390149 00002000:00010000:2.0:1785390150.211681:0:5790:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1785390150 00002000:00010000:2.0:1785390150.211683:0:5790:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1785390149 00010000:00010000:2.0:1785390150.211690:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 9 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.211703:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 9 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.211728:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5eda17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c257 expref: 9 pid: 6597 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.211748:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390150.211753:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390150.211761:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.211771:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.211811:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390150.211885:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2357:x1872116847831680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 261us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390150.211892:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00010000:00010000:0.0:1785390150.212573:0:7936:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212595:0:7936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212622:0:7936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212629:0:7936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212636:0:7936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212643:0:7936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390150.212655:0:7936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212664:0:7936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212677:0:7936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.212684:0:7936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5eda56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390150.212754:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847831424:12345-192.168.202.54@tcp:1:lfs.0 Request processed in 16656us (16860us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390150.212763:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1785390150.227774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390150.227877:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847831936 00000100:00100000:1.0:1785390150.227890:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847831936 00000100:00100000:1.0:1785390150.227956:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:1.0:1785390150.227967:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508786450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+43:11582:x1872116847831936:12345-192.168.202.54@tcp:35:lfs.0 00000004:00010000:1.0:1785390150.228045:0:5805:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4400/0x33dffe75ff5eda48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c26c expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390150.228639:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1785390150.228695:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1785390150.229901:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1785390150.229962:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.229980:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.229999:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.230041:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.230057:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 47 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390150.230073:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc98a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1872116879287680:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390150.230181:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50946b600 going to sleep for 11 seconds 00000100:00100000:1.0:1785390150.253719:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.253798:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847832064 00000100:00100000:3.0:1785390150.253809:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847832064 00010000:00010000:3.0:1785390150.253866:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 48 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390150.253918:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1785390150.253927:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:2359:x1872116847832064:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390150.253942:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390150.253949:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 48 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.253982:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 48 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.254009:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:3.0:1785390150.254016:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.254028:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.254036:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.254062:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390150.254133:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+48:2359:x1872116847832064:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 207us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.254140:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00010000:00010000:2.0:1785390150.254673:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4c00/0x33dffe75ff5eda02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c249 expref: 47 pid: 5803 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390150.254693:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc98a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1872116879287680:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390150.254717:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.254727:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.254734:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390150.254895:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1785390150.255334:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1785390150.255462:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879287808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785390150.255518:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390150.255596:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f3e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1785390150.255712:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879287808 00000100:00100000:1.0:1785390150.255718:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879287808 00000100:00100000:1.0:1785390150.255775:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785390150.255784:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879287808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785390150.255857:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879287808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390150.255864:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1785390150.255988:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390150.256011:0:5805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1785390150.256017:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf50dcc3b80, transno 4294967307 00000100:00100000:2.0:1785390150.256063:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879287808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1785390150.256721:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1785390150.256769:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf50e12df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879287936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1785390150.256806:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390150.256833:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f3e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1785390150.257557:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879287936 00000100:00100000:1.0:1785390150.257563:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879287936 00000100:00100000:1.0:1785390150.257593:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785390150.257599:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1872116879287936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1785390150.257768:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1872116879287936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 168us (961us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1785390150.257787:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785390150.257921:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf50e12df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1872116879287936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1785390150.257962:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1785390150.258002:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.258013:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.258021:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.258028:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390150.258038:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.258047:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.258064:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:3.0:1785390150.258067:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1785390150.258072:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.258078:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5200/0x33dffe75ff5eda5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785390150.258265:0:5805:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1785390150.258358:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1785390150.258368:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 458812843466ns, next at 459812841543ns, rc = 0 00000001:00080000:3.0:1785390150.258373:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1785390150.258403:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf520a1d100) 00010000:00010000:3.0:1785390150.258416:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1785390150.258422:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4400/0x33dffe75ff5eda48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c26c expref: 51 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390150.258545:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508786450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:11582:x1872116847831936:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 30560us (30765us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1785390150.258553:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000020:00080000:3.0:1785390150.258557:0:5805:0:(tgt_main.c:787:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1785390150.267068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.267209:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847832192 00000100:00100000:2.0:1785390150.267220:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847832192 00000100:00100000:2.0:1785390150.267303:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:2.0:1785390150.267313:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+50:11582:x1872116847832192:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390150.267343:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390150.267369:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5eda64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c273 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.267454:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5eda64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c273 expref: 51 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.267471:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5eda64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c273 expref: 51 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.267491:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390150.267495:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785390150.267499:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121de00, rc 0) 00000100:00100000:2.0:1785390150.267595:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:11582:x1872116847832192:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 282us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390150.267603:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 203 00000100:00100000:1.0:1785390150.279594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.279693:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847832448 00000100:00100000:3.0:1785390150.279706:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847832448 00000100:00100000:3.0:1785390150.279769:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1785390150.279781:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+51:11582:x1872116847832448:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390150.280098:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:11582:x1872116847832448:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 320us (516us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1785390150.280256:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1785390150.506196:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390150.506337:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847832576 00000100:00100000:0.0:1785390150.506350:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847832576 00000100:00100000:0.0:1785390150.506423:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:0.0:1785390150.506433:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:11592:x1872116847832576:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:0.0:1785390150.506564:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506583:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506599:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506614:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506621:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506626:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506766:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506774:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506797:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1785390150.506851:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506864:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506870:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506877:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506883:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390150.506888:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506896:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506908:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:0.0:1785390150.506911:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390150.506916:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506922:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5eda6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506937:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506963:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506968:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506974:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390150.506977:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506984:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.506992:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50896ce00) 00010000:00010000:0.0:1785390150.506995:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390150.506998:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507005:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5eda72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507026:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507033:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507039:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507044:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390150.507054:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507060:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507068:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:0.0:1785390150.507070:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390150.507073:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.507080:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717e00/0x33dffe75ff5eda79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390150.507430:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:11592:x1872116847832576:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 995us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390150.507439:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 204 00000100:00100000:0.0:1785390150.574104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.574290:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847832832 00000100:00100000:2.0:1785390150.574304:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847832832 00000100:00100000:2.0:1785390150.574608:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:2.0:1785390150.574626:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+52:11595:x1872116847832832:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390150.574663:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390150.574692:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5eda80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c27a expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.574805:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.574823:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.574837:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.574853:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.574861:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.574868:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575045:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575055:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575061:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390150.575070:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1785390150.575167:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575172:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575183:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575189:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390150.575193:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575202:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575778:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390150.575782:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390150.575788:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575796:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5eda87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575814:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575820:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575827:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575833:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121cc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390150.575844:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575861:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575870:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50629b100) 00010000:00010000:2.0:1785390150.575872:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390150.575874:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575881:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5eda8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575937:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5eda80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c27a expref: 55 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575964:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c27a expref: 54 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.575973:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390150.575975:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390150.575978:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c800, rc 0) 00000100:00100000:2.0:1785390150.576051:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11595:x1872116847832832:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1433us (1960us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1785390150.576059:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 205 00000100:00100000:1.0:1785390150.582681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.585597:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847832960 00000100:00100000:3.0:1785390150.585616:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847832960 00000100:00100000:3.0:1785390150.585829:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:3.0:1785390150.585852:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11595:x1872116847832960:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1785390150.585964:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.585984:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.585998:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586031:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586038:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586046:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586053:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390150.586058:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586067:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586097:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390150.586100:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390150.586106:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.586112:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edaa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390150.587891:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11595:x1872116847832960:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 2046us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.587902:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 206 00000100:00100000:1.0:1785390150.591200:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.591313:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847833216 00000100:00100000:3.0:1785390150.591325:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847833216 00000100:00100000:3.0:1785390150.591385:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1785390150.591395:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+54:11595:x1872116847833216:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390150.591721:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:11595:x1872116847833216:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 326us (530us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1785390150.591729:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1785390150.720907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390150.721515:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847833472 00000100:00100000:1.0:1785390150.721556:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847833472 00000100:00100000:1.0:1785390150.721629:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:1.0:1785390150.721640:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+55:11605:x1872116847833472:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1785390150.721911:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390150.721915:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1785390150.721952:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5eda25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c25e expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.721977:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390150.721983:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390150.722002:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edaaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c281 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.722130:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.722145:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.722158:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390150.722190:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1785390150.722336:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edaaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c281 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.722353:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c281 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.722362:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390150.722365:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390150.722368:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4e00, rc 0) 00000100:00100000:1.0:1785390150.723600:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11605:x1872116847833472:12345-192.168.202.54@tcp:101:bash.0 Request processed in 1958us (2700us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1785390150.723612:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 207 00000100:00100000:3.0:1785390150.726486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.726707:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847833728 00000100:00100000:2.0:1785390150.726719:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847833728 00000100:00100000:2.0:1785390150.726768:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 208 00000100:00100000:2.0:1785390150.726779:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+56:11605:x1872116847833728:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:2.0:1785390150.726873:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1785390150.726905:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c281 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.726930:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5eda95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c27a expref: 55 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.726942:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390150.726948:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390150.727188:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.727203:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.727214:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1785390150.727272:0:7121:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1785390150.727300:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d95a0aae reply state 0000000001a0b059 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390150.727310:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390150.727405:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11605:x1872116847833728:12345-192.168.202.54@tcp:36:bash.0 Request processed in 627us (928us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1785390150.727414:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 208 00000020:00080000:2.0:1785390150.727418:0:7121:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1785390150.729284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.729740:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847833856 00000100:00100000:2.0:1785390150.729750:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847833856 00000100:00100000:2.0:1785390150.729802:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:2.0:1785390150.729822:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11605:x1872116847833856:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390150.729848:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390150.729863:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c288 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.729933:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.729955:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.729963:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.729981:0:5802:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.729991:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737754:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737779:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737788:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737796:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121cc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390150.737802:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737811:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737854:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:0.0:1785390150.737857:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390150.737861:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737871:0:3293:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737879:0:3293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737921:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.737928:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5edabf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.738071:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.738081:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390150.738137:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1785390150.738142:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390150.738165:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.738209:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.738234:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 57 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.738243:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390150.738246:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390150.738249:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c400, rc 0) 00000100:00100000:2.0:1785390150.738336:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11605:x1872116847833856:12345-192.168.202.54@tcp:101:bash.0 Request processed in 8512us (9056us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390150.738345:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 209 00000100:00100000:3.0:1785390150.740798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.740879:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847834112 00000100:00100000:2.0:1785390150.740889:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847834112 00000100:00100000:2.0:1785390150.740959:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1785390150.740968:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+57:11605:x1872116847834112:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:2.0:1785390150.741220:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11605:x1872116847834112:12345-192.168.202.54@tcp:35:bash.0 Request processed in 252us (428us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1785390150.741228:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:3.0:1785390150.827029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390150.827168:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847834240 00000100:00100000:2.0:1785390150.827181:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847834240 00000100:00100000:2.0:1785390150.827257:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:2.0:1785390150.827270:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+58:11611:x1872116847834240:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390150.827306:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390150.827333:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c28f expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.827414:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edadb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.827450:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.827464:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390150.827566:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1785390150.827570:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390150.827593:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.827619:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c28f expref: 60 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.827640:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edadb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c28f expref: 59 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.827679:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390150.827681:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390150.827685:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c800, rc 0) 00000100:00100000:2.0:1785390150.827754:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11611:x1872116847834240:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 487us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390150.827762:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 210 00000100:00100000:0.0:1785390150.832318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390150.832418:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847834368 00000100:00100000:1.0:1785390150.832429:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847834368 00000100:00100000:1.0:1785390150.832492:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:1.0:1785390150.832502:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11611:x1872116847834368:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390150.832558:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390150.832580:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c296 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832661:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832678:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832709:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832725:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832732:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832738:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832867:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832876:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832882:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390150.832921:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1785390150.832925:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390150.832950:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832962:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832970:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832987:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.832995:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833002:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390150.833007:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833016:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833028:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390150.833031:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390150.833036:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833042:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5000/0x33dffe75ff5edae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833057:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833064:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833070:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833075:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390150.833082:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833089:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833096:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf510c5a100) 00010000:00010000:1.0:1785390150.833098:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390150.833101:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833106:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4800/0x33dffe75ff5edaf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833137:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 61 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833149:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390150.833157:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390150.833159:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390150.833162:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5c00, rc 0) 00000100:00100000:1.0:1785390150.833232:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11611:x1872116847834368:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 730us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390150.833239:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 211 00000100:00100000:3.0:1785390150.838279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.838330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390150.838420:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847834752 00000100:00100000:0.0:1785390150.838430:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847834752 00000100:00100000:0.0:1785390150.838482:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:0.0:1785390150.838492:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11611:x1872116847834752:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390150.838516:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390150.838569:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5edafe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c29d expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838684:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838699:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838722:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 61 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838730:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838771:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 61 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838786:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 61 pid: 5803 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390150.838801:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879288064:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390150.838909:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.838919:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390150.838928:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879288192:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390150.838949:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390150.839465:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847834496 00000100:00100000:2.0:1785390150.839470:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847834496 00010000:00010000:2.0:1785390150.839494:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 62 pid: 5803 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390150.839543:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1785390150.839556:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:2357:x1872116847834496:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390150.839567:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390150.839573:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 62 pid: 5803 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.839585:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 62 pid: 5803 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.839603:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390150.839608:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.839614:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.839619:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390150.839662:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+62:2357:x1872116847834496:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 106us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390150.839668:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00010000:00010000:0.0:1785390150.846033:0:7121:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.54@tcp) returned -22 from blocking AST (req@0000000014940992 x1872116879288064) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 61 pid: 5803 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.846062:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edaf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c296 expref: 61 pid: 5803 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390150.846096:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879288064:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390150.846112:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879288192:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390150.846145:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:0.0:1785390150.846150:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.846158:0:7121:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390150.846167:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390150.852268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.854502:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847834880 00000100:00100000:3.0:1785390150.854516:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847834880 00010000:00010000:3.0:1785390150.855006:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390150.855085:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1785390150.855097:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+61:2359:x1872116847834880:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390150.855114:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390150.855122:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.855137:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.855162:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edacd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c288 expref: 61 pid: 5802 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.855184:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390150.855191:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.855201:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.855210:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.855255:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390150.855325:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:2359:x1872116847834880:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 229us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.855332:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00010000:00010000:2.0:1785390150.855395:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.855411:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390150.855432:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1785390150.855620:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716200/0x33dffe75ff5edafe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 61 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.855657:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 60 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390150.855664:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390150.855667:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1785390150.855669:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:2.0:1785390150.855694:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11611:x1872116847834752:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 17205us (17365us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1785390150.855701:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 212 00000100:00100000:2.0:1785390150.865625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.868993:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847835136 00000100:00100000:3.0:1785390150.869008:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847835136 00000100:00100000:3.0:1785390150.869093:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1785390150.869104:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e06bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11611:x1872116847835136:12345-192.168.202.54@tcp:103:lfs.0 00010000:00010000:3.0:1785390150.869125:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390150.869155:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5eda64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c273 expref: 60 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.869180:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390150.869185:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390150.869256:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e06bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11611:x1872116847835136:12345-192.168.202.54@tcp:103:lfs.0 Request processed in 153us (3641us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.869265:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1785390150.881636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.881730:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847835264 00000100:00100000:3.0:1785390150.881742:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847835264 00000100:00100000:3.0:1785390150.881810:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:3.0:1785390150.881820:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11611:x1872116847835264:12345-192.168.202.54@tcp:58:lfs.0 00010000:00010000:3.0:1785390150.881953:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.881972:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.881985:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785390150.882206:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1785390150.882318:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11611:x1872116847835264:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 498us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.882344:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:0.0:1785390150.884239:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390150.884309:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847835392 00000100:00100000:3.0:1785390150.884317:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847835392 00000100:00100000:3.0:1785390150.884360:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:3.0:1785390150.884368:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+59:11611:x1872116847835392:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390150.884386:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390150.884411:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2a4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.884462:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.884472:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.884491:0:5804:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.884506:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.884519:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390150.884522:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390150.884676:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390150.884685:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5000, rc 0) 00000100:00100000:3.0:1785390150.884741:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+60:11611:x1872116847835392:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 373us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390150.884748:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00010000:00010000:2.0:1785390151.126057:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1785390151.277098:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967481 is committed 00000004:00080000:3.0:1785390151.277113:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1785390151.277140:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf509e38d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1785390151.277146:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf541403400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf522ecf840 00000020:00080000:3.0:1785390151.277149:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf541403e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf53f7f1000 00000001:00080000:3.0:1785390151.277176:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000020:00080000:3.0:1785390151.277205:0:5824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1785390151.277213:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000020:00080000:3.0:1785390151.277228:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf53f3e7180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1785390151.277231:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf535ac5600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf53f3e7780 00000020:00080000:3.0:1785390151.277235:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf535ac5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf50698c400 00000004:00080000:3.0:1785390151.277269:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1785390151.277516:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1785390151.277775:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1785390151.278744:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785390151.278769:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879288320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1785390151.278852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390151.278935:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879288320 00000100:00100000:0.0:1785390151.278944:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879288320 00000100:00100000:0.0:1785390151.279019:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1785390151.279029:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879288320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1785390151.279065:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1785390151.279095:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.279122:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.279144:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1785390151.279149:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1785390151.279154:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.279183:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.279197:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 8 pid: 6597 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.279210:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1872116879288448:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390151.279274:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182a8f00 going to sleep for 11 seconds 00000100:00080000:0.0:1785390151.279291:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1785390151.287425:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1785390151.287463:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:1.0:1785390151.288237:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390151.290482:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879288576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1785390151.290598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390151.293575:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6598:1872116879288448:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390151.293614:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.294121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.294350:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847835520 00000100:00100000:2.0:1785390151.294359:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847835520 00010000:00010000:2.0:1785390151.294436:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 7 pid: 6597 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.294472:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1785390151.294483:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847835520:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390151.294506:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390151.294514:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 7 pid: 6597 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294546:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 7 pid: 6597 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294598:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5ed968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c234 expref: 7 pid: 6597 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294618:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390151.294624:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390151.294630:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294651:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294679:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390151.294732:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2360:x1872116847835520:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 250us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.294740:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00010000:00010000:2.0:1785390151.294766:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294776:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294788:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294799:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.294822:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785390151.295517:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1872116879288320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16488us (16663us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1785390151.295563:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1785390151.295581:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879288576 00000100:00100000:2.0:1785390151.295586:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879288576 00000100:00080000:1.0:1785390151.295758:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785390151.297436:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785390151.297539:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1785390151.297547:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1785390151.297577:0:3308:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf53f7f9c00 x1872116879288320/t4294967319(4294967319) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1785390167 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1785390151.297590:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf53f7f9c00/2, rc 0, transno 4294967319 00000100:00100000:0.0:1785390151.297595:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879288320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1785390151.297973:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879288576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1785390151.298022:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1785390151.298072:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a6ae445, atime: 0x6a6ae446, ctime: 0x6a6ae445, blocks: 0x1 00010000:00010000:1.0:1785390151.298081:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.298097:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1785390151.298102:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390151.298109:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.298125:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.298135:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.298162:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.298185:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1785390151.298846:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879288576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1385us (8235us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1785390151.298856:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:1.0:1785390151.298897:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf541d4c700/2, rc 0, transno 4294967310 00000100:00100000:1.0:1785390151.298903:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879288576:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1785390151.301468:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785390151.301498:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301512:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390151.301517:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301551:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301573:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301580:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e85428f/0x33dffe75ff5edb21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301603:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390151.301607:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301613:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390151.301622:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301629:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301658:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301664:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5edb28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.301679:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390151.301681:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390151.301682:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390151.302495:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1785390151.381972:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785390151.381993:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785390151.382042:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1785390151.382050:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785390151.382203:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fdfd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879288704:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785390151.382330:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390151.385461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.385651:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fdfd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879288704:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785390151.390225:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847835648 00000100:00100000:0.0:1785390151.390245:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847835648 00000100:00100000:1.0:1785390151.390491:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:1.0:1785390151.390504:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11612:x1872116847835648:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785390151.390569:0:5803:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785390151.390715:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11612:x1872116847835648:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 213us (5262us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390151.390722:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 215 00000100:00100000:1.0:1785390151.397033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.397180:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847835776 00000100:00100000:2.0:1785390151.397193:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847835776 00000100:00100000:2.0:1785390151.397264:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:2.0:1785390151.397276:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11612:x1872116847835776:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785390151.397367:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397388:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397411:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397430:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397437:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397444:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397476:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397503:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397509:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390151.397593:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1785390151.397599:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390151.397613:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397624:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397631:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397648:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397653:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390151.397658:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397666:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397677:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:2.0:1785390151.397680:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390151.397683:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397699:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397713:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397719:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397726:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397730:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390151.397733:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397739:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397747:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cf50629b200) 00010000:00010000:2.0:1785390151.397749:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390151.397752:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397757:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397773:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397779:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397792:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397798:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390151.397801:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397807:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397814:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390151.397816:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390151.397820:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.397826:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.397920:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11612:x1872116847835776:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 646us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.397927:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 216 00000100:00100000:0.0:1785390151.410495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390151.411067:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847836032 00000100:00100000:1.0:1785390151.411081:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847836032 00000100:00100000:1.0:1785390151.411157:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:1.0:1785390151.411167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11612:x1872116847836032:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390151.411199:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390151.411226:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edb44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2ab expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411378:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411405:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411419:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390151.411433:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1785390151.411823:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411831:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411837:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411842:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390151.411846:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411854:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411865:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390151.411868:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1785390151.411873:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411889:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411935:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edb44 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ab expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411946:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:1.0:1785390151.411947:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390151.411951:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edb44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ab expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.411960:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5800, rc 0) 00000100:00100000:1.0:1785390151.412084:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847836032:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 918us (1601us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1785390151.412091:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 217 00000100:00100000:3.0:1785390151.417240:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.417309:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847836160 00000100:00100000:2.0:1785390151.417322:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847836160 00000100:00100000:2.0:1785390151.417391:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:2.0:1785390151.417407:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fdfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847836160:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1785390151.417452:0:7121:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1785390151.424141:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fdfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847836160:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 6720us (6898us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.424184:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:3.0:1785390151.432142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.433498:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847836416 00000100:00100000:2.0:1785390151.433513:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847836416 00000100:00100000:2.0:1785390151.433704:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:2.0:1785390151.433715:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847836416:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390151.433744:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390151.433747:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1785390151.433782:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edadb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c28f expref: 19 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.433807:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390151.433812:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390151.433828:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2b2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1785390151.437123:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1785390151.438775:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.438798:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.438814:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.439091:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b2 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.439136:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b2 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.439146:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf50629b200) 00010000:00010000:2.0:1785390151.439149:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390151.439152:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d000, rc 0) 00000100:00100000:2.0:1785390151.439289:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf506988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11612:x1872116847836416:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 5574us (7160us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1785390151.439299:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:1.0:1785390151.453137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.454039:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847836672 00000100:00100000:3.0:1785390151.454071:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847836672 00000100:00100000:3.0:1785390151.454133:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1785390151.454144:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11612:x1872116847836672:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785390151.454218:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390151.454253:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edb60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b2 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454275:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf50629b200) 00010000:00010000:3.0:1785390151.454289:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390151.454323:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454340:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454352:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454369:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454376:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454382:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454720:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454729:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454742:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454748:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390151.454754:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454763:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454772:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:3.0:1785390151.454775:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390151.454780:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454786:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edb6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454797:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454804:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454811:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454816:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390151.454819:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454843:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454852:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2483bdf0 (ffff8cf520a1da00) 00010000:00010000:3.0:1785390151.454854:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390151.454857:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.454864:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edb75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2483bdf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390151.454976:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847836672:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 832us (1851us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785390151.454984:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 220 00000100:00100000:3.0:1785390151.458182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390151.458278:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847836800 00000100:00100000:1.0:1785390151.458290:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847836800 00000100:00100000:1.0:1785390151.458351:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:1.0:1785390151.458362:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847836800:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390151.458386:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390151.458418:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2b9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.458458:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.458487:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.458498:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.458620:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5e00/0x33dffe75ff5edb7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.458650:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.458661:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:1.0:1785390151.458664:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785390151.458667:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4c00, rc 0) 00000100:00100000:1.0:1785390151.458724:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11612:x1872116847836800:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 365us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390151.458731:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 221 00000100:00100000:1.0:1785390151.463728:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.463863:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847837056 00000100:00100000:3.0:1785390151.463877:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847837056 00000100:00100000:3.0:1785390151.463946:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 222 00000100:00100000:3.0:1785390151.463957:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11612:x1872116847837056:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1785390151.464066:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.464085:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.464098:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785390151.464440:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1785390151.464471:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460018945700ns, next at 461018942786ns, rc = 0 00000004:00010000:3.0:1785390151.464607:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ca9a80f reply state 000000000bd776c6 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390151.464617:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390151.464723:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:11612:x1872116847837056:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 769us (1008us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1785390151.464732:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 222 00010000:00010000:3.0:1785390151.470319:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.470344:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.470353:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.470360:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390151.470366:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.470376:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.470403:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:3.0:1785390151.470407:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785390151.470413:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.470420:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5200/0x33dffe75ff5edb8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.478721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.479093:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847837184 00000100:00100000:2.0:1785390151.479106:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847837184 00000100:00100000:2.0:1785390151.479187:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:2.0:1785390151.479199:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:11612:x1872116847837184:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390151.479231:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390151.479259:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2c0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.479339:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.479356:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.479376:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:2.0:1785390151.479379:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785390151.479401:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c600, rc 0) 00000100:00100000:2.0:1785390151.479473:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:11612:x1872116847837184:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 277us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.479481:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:1.0:1785390151.493210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390151.493327:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847837312 00000100:00100000:0.0:1785390151.493340:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847837312 00000100:00100000:0.0:1785390151.493420:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:0.0:1785390151.493433:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+6:2359:x1872116847837312:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1785390151.494074:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847837312:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 643us (878us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1785390151.494084:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:0.0:1785390151.509080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.513275:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847837568 00000100:00100000:2.0:1785390151.513298:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847837568 00000100:00100000:2.0:1785390151.513721:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:2.0:1785390151.513734:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:11612:x1872116847837568:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1785390151.514048:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11612:x1872116847837568:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 316us (4978us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1785390151.514057:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:3.0:1785390151.520387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390151.524806:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847837824 00000100:00100000:0.0:1785390151.524825:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847837824 00000100:00100000:0.0:1785390151.525094:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:0.0:1785390151.525105:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11612:x1872116847837824:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1785390151.525588:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11612:x1872116847837824:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 484us (5211us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.525611:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:1.0:1785390151.535563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.535598:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847837952 00000100:00100000:2.0:1785390151.535612:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847837952 00000100:00100000:2.0:1785390151.535702:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:2.0:1785390151.535712:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11612:x1872116847837952:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390151.535742:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390151.535769:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edb98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2c7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.535864:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.535881:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.535895:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390151.535966:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390151.535990:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.536023:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5edb98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c7 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.536040:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c7 expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.536052:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:2.0:1785390151.536055:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1785390151.536059:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d200, rc 0) 00000100:00100000:2.0:1785390151.536129:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11612:x1872116847837952:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 418us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.536136:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 225 00000100:00100000:3.0:1785390151.540799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.541316:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838080 00000100:00100000:2.0:1785390151.541330:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838080 00000100:00100000:2.0:1785390151.542187:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:2.0:1785390151.542211:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847838080:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390151.542236:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390151.542263:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2ce expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390151.542310:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6ae447, blocks: 0x1 00010000:00010000:2.0:1785390151.542334:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1785390151.542353:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390151.542364:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.542385:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.542416:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d400, rc 0) 00000100:00100000:2.0:1785390151.542511:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf511080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2358:x1872116847838080:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 314us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.542519:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:3.0:1785390151.548129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390151.550979:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838336 00000100:00100000:1.0:1785390151.550999:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838336 00000100:00100000:1.0:1785390151.551075:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:1.0:1785390151.551085:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11612:x1872116847838336:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1785390151.551292:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11612:x1872116847838336:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 206us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390151.551320:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 226 00000100:00100000:3.0:1785390151.561693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390151.564141:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838464 00000100:00100000:0.0:1785390151.564158:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838464 00000100:00100000:0.0:1785390151.564548:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1785390151.564561:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:11612:x1872116847838464:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390151.564585:0:6597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390151.564621:0:6597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2d5 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.564676:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.564687:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390151.564692:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390151.564697:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 9 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.564736:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.564750:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 9 pid: 6598 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.564765:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1872116879288832:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390151.565064:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5182a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1785390151.594717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.595105:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838592 00000100:00100000:2.0:1785390151.595119:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838592 00010000:00010000:2.0:1785390151.595169:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 10 pid: 6598 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.595221:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:2.0:1785390151.595232:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2359:x1872116847838592:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390151.595252:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390151.595291:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 10 pid: 6598 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.595313:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 10 pid: 6598 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.595343:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390151.595364:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390151.595374:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 10 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.595507:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 10 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.595594:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 10 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.595610:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1872116879288960:192.168.202.54@tcp:105: 00000100:00100000:2.0:1785390151.595723:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a01d3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1785390151.596436:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c780983e/0x33dffe75ff5edba6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ce expref: 10 pid: 6598 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.596467:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1872116879288832:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390151.596495:0:6597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 9 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.596506:0:6597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:0.0:1785390151.596622:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:11612:x1872116847838464:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 32064us (34942us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.596630:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:2.0:1785390151.617041:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5790:1872116879288960:192.168.202.54@tcp:105: 00010000:00010000:2.0:1785390151.617076:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390151.617148:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847838592:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 21917us (22443us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.617160:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:3.0:1785390151.622074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.622401:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838720 00000100:00100000:2.0:1785390151.622413:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838720 00002000:00100000:2.0:1785390151.622475:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8cf50348f100 x1872116847838720/t0(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:137/0 lens 504/0 e 0 to 0 dl 1785390162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785390151.622486:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50348f100 with x1872116847838720 ext(0->12) 00002000:00010000:2.0:1785390151.622493:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50348f100 00000100:00100000:2.0:1785390151.622548:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:2.0:1785390151.622558:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847838720:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1785390151.623835:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2360:x1872116847838720:12345-192.168.202.54@tcp:4:lhsmtool_posix.0 Request processed in 744us (1238us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1785390151.623846:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00002000:00100000:2.0:1785390151.624765:0:6602:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8cf50348f100 x1872116847838720/t4294967321(0) o4->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:137/0 lens 504/448 e 0 to 0 dl 1785390162 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1785390151.624776:0:6602:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf50348f100 with x1872116847838720 ext(0->12) 00002000:00010000:2.0:1785390151.624782:0:6602:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf50348f100 00000100:00100000:3.0:1785390151.632125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.634123:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838848 00000100:00100000:2.0:1785390151.634139:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838848 00000100:00100000:2.0:1785390151.634216:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 227 00000100:00100000:2.0:1785390151.634228:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11612:x1872116847838848:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1785390151.702071:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879289344:0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.702161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390151.702238:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390151.702244:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879289472:0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.702273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390151.702355:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289344 00000100:00100000:0.0:1785390151.702363:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289344 00000100:00100000:0.0:1785390151.702445:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1785390151.702453:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879289344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.702511:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879289344:12345-0@lo:400:kworker.0 Request processed in 59us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.702518:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1785390151.702574:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289472 00000100:00100000:0.0:1785390151.702578:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289472 00000100:00100000:0.0:1785390151.702615:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1785390151.702647:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879289472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.702697:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879289472:12345-0@lo:400:kworker.0 Request processed in 52us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.702703:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1785390151.702718:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390151.702752:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879289472:0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.702761:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879289344:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.702832:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879289216:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.702887:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390151.702909:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879289728:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.702944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390151.702970:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1785390151.702975:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879289088:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.703001:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390151.703018:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879289600:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.703038:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390151.703058:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289088 00000100:00100000:3.0:1785390151.703061:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289088 00000100:00100000:3.0:1785390151.703087:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1785390151.703092:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879289088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.703124:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879289088:12345-0@lo:400:kworker.0 Request processed in 31us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.703130:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1785390151.703162:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879289088:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.703188:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289728 00000100:00100000:3.0:1785390151.703190:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289728 00000100:00100000:3.0:1785390151.703214:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1785390151.703220:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879289728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.703256:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879289728:12345-0@lo:400:kworker.0 Request processed in 36us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.703262:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1785390151.703287:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879289728:0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.703924:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289216 00000100:00100000:0.0:1785390151.703930:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289216 00000100:00100000:0.0:1785390151.704078:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289600 00000100:00100000:0.0:1785390151.704082:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289600 00000100:00080000:2.0:1785390151.704489:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390151.704765:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1785390151.704776:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879289216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.704835:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879289216:12345-0@lo:400:kworker.0 Request processed in 54us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.704842:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1785390151.704856:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1785390151.704862:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879289600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.704892:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879289600:12345-0@lo:400:kworker.0 Request processed in 30us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.704898:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1785390151.704924:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879289600:0@lo:400:kworker.0 00000100:00100000:3.0:1785390151.704934:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879289216:0@lo:400:kworker.0 00000100:00100000:0.0:1785390151.736164:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5411a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11612:x1872116847838848:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 101923us (104037us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.736178:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 227 00000001:00080000:3.0:1785390151.738011:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:3.0:1785390151.738027:0:5824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1785390151.738049:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1785390151.738062:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1785390151.738232:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1785390151.738249:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1785390151.738788:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879289856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1785390151.738871:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390151.739100:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879289856 00000100:00100000:2.0:1785390151.739110:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879289856 00000100:00100000:2.0:1785390151.739168:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1785390151.739177:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879289856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1785390151.739363:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1785390151.739367:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1785390151 00002000:00010000:2.0:1785390151.739369:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1785390151.739372:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1785390151 -> 1785390151 00002000:00010000:2.0:1785390151.739374:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785390151.739569:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879289856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 393us (703us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1785390151.739577:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1785390151.739682:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf53fc02a00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1785390151.739689:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879289856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1785390151.740658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.740871:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847838976 00000100:00100000:3.0:1785390151.740878:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847838976 00000100:00100000:3.0:1785390151.740921:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1785390151.740928:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+10:2359:x1872116847838976:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1785390151.827183:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1785390151.827207:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1785390151.827213:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1785390151.828515:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2359:x1872116847838976:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 87577us (87851us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.828562:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1785390151.835766:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390151.836489:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847839232 00000100:00100000:1.0:1785390151.836502:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847839232 00000100:00100000:1.0:1785390151.837055:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:1.0:1785390151.837067:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11612:x1872116847839232:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785390151.837139:0:7121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390151.837172:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5edb9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c7 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.837192:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:1.0:1785390151.837197:0:7121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390151.837235:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.837251:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.837261:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1785390151.837917:0:7121:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f040949 reply state 00000000d7f621de transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.837927:0:7121:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390151.838177:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:11612:x1872116847839232:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 1111us (2422us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1785390151.838185:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00010000:00010000:2.0:1785390151.841599:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.841630:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.842962:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.842971:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390151.842984:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.842994:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.843014:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:2.0:1785390151.843017:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390151.843022:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.843029:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5edbb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.843192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.843264:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847839360 00000100:00100000:2.0:1785390151.843280:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847839360 00000100:00100000:2.0:1785390151.843341:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1785390151.843351:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847839360:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785390151.843723:0:7936:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1785390151.843727:0:7936:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1785390151 -> 1785390150 00002000:00010000:2.0:1785390151.843730:0:7936:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1785390150 00002000:00010000:2.0:1785390151.843732:0:7936:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1785390151 -> 1785390150 00002000:00010000:2.0:1785390151.843746:0:7936:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1785390151.843853:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847839360:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 501us (664us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1785390151.843869:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 70 00000100:00100000:2.0:1785390151.846876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390151.847039:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847839616 00000100:00100000:0.0:1785390151.847051:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847839616 00000100:00100000:0.0:1785390151.847131:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:0.0:1785390151.847141:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:11612:x1872116847839616:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1785390151.847243:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.847265:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.847275:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.847325:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.847345:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 20 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.847361:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879289984:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390151.847484:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5012ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1785390151.850185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390151.850563:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1872116879289984:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390151.850589:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.851142:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847839744 00000100:00100000:2.0:1785390151.851152:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847839744 00010000:00010000:2.0:1785390151.851192:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.851237:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1785390151.851247:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:2359:x1872116847839744:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390151.851263:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390151.851272:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.851285:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.851309:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5edb83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2b9 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.851328:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:2.0:1785390151.851334:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.851346:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.851370:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.851507:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390151.851592:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:2359:x1872116847839744:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 345us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.851605:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00010000:00010000:1.0:1785390151.852270:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852280:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852318:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852325:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852332:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852337:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390151.852341:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852348:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852357:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:1.0:1785390151.852359:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1785390151.852363:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.852369:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717400/0x33dffe75ff5edbbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.852434:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847839616:12345-192.168.202.54@tcp:55:lhsmtool_posix.0 Request processed in 5295us (5574us total) trans 0 rc -22/-22 00000100:00100000:1.0:1785390151.852455:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:0.0:1785390151.855188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.855286:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847839872 00000100:00100000:3.0:1785390151.855296:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847839872 00000100:00100000:3.0:1785390151.855380:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:3.0:1785390151.855397:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847839872:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1785390151.855448:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.855472:0:6597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.855481:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390151.855485:0:6597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1785390151.855489:0:6597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.855552:0:6597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 8 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.855587:0:6597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 8 pid: 6597 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390151.855605:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1872116879290112:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390151.855694:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5183d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1785390151.858242:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6597:1872116879290112:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390151.858281:0:6597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.858405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.858568:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847840000 00000100:00100000:2.0:1785390151.858575:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847840000 00010000:00010000:2.0:1785390151.858611:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 9 pid: 6597 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.858665:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:2.0:1785390151.858674:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+9:2359:x1872116847840000:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390151.858688:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390151.858714:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 9 pid: 6597 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.858726:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 9 pid: 6597 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.858751:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d191259/0x33dffe75ff5edbad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2d5 expref: 9 pid: 6597 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.858770:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390151.858774:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390151.858793:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.858803:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.858831:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390151.859030:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2359:x1872116847840000:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 356us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.859037:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00010000:00010000:0.0:1785390151.859309:0:6597:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859330:0:6597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859355:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859362:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859370:0:6597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859376:0:6597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390151.859380:0:6597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859397:0:6597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859410:0:6597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.859417:0:6597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c03980/0x33dffe75ff5edbc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.859485:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2360:x1872116847839872:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 4097us (4305us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.859493:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 71 00000100:00100000:3.0:1785390151.862174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390151.862246:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847840256 00000100:00100000:1.0:1785390151.862257:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847840256 00000100:00100000:1.0:1785390151.862311:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 230 00000100:00100000:1.0:1785390151.862322:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11612:x1872116847840256:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1785390151.862419:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.862435:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.862449:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.862950:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.862962:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.862972:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.863086:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.863100:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 20 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.863128:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879290240:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390151.863286:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535f4d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390151.866284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390151.866342:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847840384 00000100:00100000:0.0:1785390151.866350:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847840384 00010000:00010000:0.0:1785390151.866386:0:11040:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.866431:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1785390151.866444:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:2360:x1872116847840384:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390151.866458:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390151.866465:0:11040:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.866479:0:11040:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 21 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.866503:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:0.0:1785390151.866508:0:11040:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.866519:0:11040:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.866548:0:11040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.866583:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390151.866643:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:2360:x1872116847840384:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 192us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390151.866652:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00010000:00010000:1.0:1785390151.867439:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c600/0x33dffe75ff5edb91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2c0 expref: 20 pid: 5803 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.867457:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879290240:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390151.867477:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.867486:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.867492:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390151.867720:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1785390151.868172:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1785390151.868225:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1785390151.868333:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879290368:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785390151.868407:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390151.868443:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a01d300 going to sleep for 11 seconds 00000100:00100000:1.0:1785390151.868790:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879290368 00000100:00100000:1.0:1785390151.868796:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879290368 00000100:00100000:1.0:1785390151.868839:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785390151.868846:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5804:x1872116879290368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1785390151.869040:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5804:x1872116879290368:12345-0@lo:1000:mdt00_002.0 Request processed in 193us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390151.869047:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785390151.869195:0:5804:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1785390151.869202:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf53f7f9c00, transno 4294967319 00000004:00080000:3.0:1785390151.869217:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf53fc02a00, transno 4294967322 00000100:00100000:3.0:1785390151.869223:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879290368:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1785390151.870821:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1785390151.871052:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879290496:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1785390151.871098:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390151.871175:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51dde0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1785390151.871493:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879290496 00000100:00100000:1.0:1785390151.871500:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879290496 00000100:00100000:2.0:1785390151.871789:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785390151.871798:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5804:x1872116879290496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1785390151.872081:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1872116879290496:12345-0@lo:1000:mdt00_002.0 Request processed in 284us (981us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1785390151.872088:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785390151.872155:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1872116879290496:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1785390151.872192:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872202:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872225:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872233:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390151.872238:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872248:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872269:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf510c5ac00) 00010000:00010000:3.0:1785390151.872272:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390151.872278:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872284:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5edbd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872317:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872323:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872328:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872332:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390151.872335:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872348:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872355:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390151.872357:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1785390151.872363:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872374:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872383:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.872418:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390151.872429:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879290624:192.168.202.54@tcp:105: 00000100:00100000:3.0:1785390151.872505:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51dde0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390151.875139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.875167:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847840512 00000100:00100000:3.0:1785390151.875175:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847840512 00000100:00100000:3.0:1785390151.875231:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:3.0:1785390151.875241:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11611:x1872116847840512:12345-192.168.202.54@tcp:49:lfs.0 00000100:00100000:3.0:1785390151.875355:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+24:11611:x1872116847840512:12345-192.168.202.54@tcp:49:lfs.0 Request processed in 117us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.875379:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:1.0:1785390151.875578:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1872116879290624:192.168.202.54@tcp:105: 00010000:00010000:1.0:1785390151.875609:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875618:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5c00/0x33dffe75ff5edb13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875664:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875676:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875687:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875695:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875701:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875707:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875711:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390151.875714:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875721:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875730:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390151.875734:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390151.875743:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875749:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5a00/0x33dffe75ff5edbd7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875759:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875766:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875772:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875777:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390151.875779:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875785:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875792:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390151.875794:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785390151.875796:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.875802:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4a00/0x33dffe75ff5edbc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.876015:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11612:x1872116847840256:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 13694us (13847us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1785390151.876022:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 230 00000020:00080000:1.0:1785390151.876031:0:5804:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1785390151.876323:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785390151.876328:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785390151.877038:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1785390151.877047:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785390151.880422:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.880491:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847840768 00000100:00100000:3.0:1785390151.880502:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847840768 00000100:00100000:3.0:1785390151.880572:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:3.0:1785390151.880582:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11611:x1872116847840768:12345-192.168.202.54@tcp:58:lfs.0 00000040:00080000:3.0:1785390151.881229:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1785390151.881315:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11611:x1872116847840768:12345-192.168.202.54@tcp:58:lfs.0 Request processed in 735us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390151.881322:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 231 00000100:00100000:1.0:1785390151.882347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.882401:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847841024 00000100:00100000:3.0:1785390151.882406:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847841024 00000100:00100000:3.0:1785390151.882438:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:3.0:1785390151.882445:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508784450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+23:11612:x1872116847841024:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1785390151.883344:0:5805:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1785390151.883441:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1785390151.883485:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.883503:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.883516:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.887625:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.888119:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.888130:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390151.888183:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1785390151.888313:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508784450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+25:11612:x1872116847841024:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 5862us (5961us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1785390151.888326:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000020:00080000:3.0:1785390151.888333:0:5805:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1785390151.894839:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390151.894855:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.894873:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390151.894878:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.894889:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.894908:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf520a1da00) 00010000:00010000:0.0:1785390151.894911:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1785390151.894916:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.894921:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edbde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390151.894957:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390151.894960:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390151.894962:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390151.919660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390151.919810:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847841152 00000100:00100000:2.0:1785390151.919830:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847841152 00000100:00100000:2.0:1785390151.919905:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 232 00000100:00100000:2.0:1785390151.919915:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+25:11614:x1872116847841152:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390151.920164:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390151.920193:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5edbe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2dc expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920295:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920314:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920329:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920348:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920354:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920360:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920847:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.920858:0:7121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 26 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.921356:0:7121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.921395:0:7121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 26 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.921420:0:7121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 26 pid: 7121 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390151.921434:0:7121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879290752:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390151.922157:0:7121:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a01d600 going to sleep for 11 seconds 00000100:00100000:1.0:1785390151.927959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390151.928599:0:7121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7121:1872116879290752:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390151.928684:0:7121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390151.928746:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847841408 00000100:00100000:0.0:1785390151.928755:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847841408 00000100:00100000:0.0:1785390151.928844:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:0.0:1785390151.928853:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:5580:x1872116847841408:12345-192.168.202.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1785390151.929350:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:5580:x1872116847841408:12345-192.168.202.54@tcp:35:ldlm_bl.0 Request processed in 496us (1408us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1785390151.929357:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 63 00000100:00100000:2.0:1785390151.932138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390151.932322:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847841536 00000100:00100000:1.0:1785390151.932333:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847841536 00010000:00010000:1.0:1785390151.932372:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 28 pid: 7121 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390151.932490:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:1.0:1785390151.932500:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:2360:x1872116847841536:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390151.932517:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390151.932546:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 28 pid: 7121 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.932561:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 28 pid: 7121 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.932588:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717800/0x33dffe75ff5edb05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c29d expref: 28 pid: 7121 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.932604:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390151.932610:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.932620:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.932627:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390151.932685:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390151.932728:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+27:2360:x1872116847841536:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 230us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390151.932736:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00010000:00010000:2.0:1785390151.932785:0:7121:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932794:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390151.932846:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1785390151.932851:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390151.932876:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932888:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932898:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932905:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932910:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932915:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390151.932927:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932935:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932951:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:2.0:1785390151.932953:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390151.932957:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932963:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5edbec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932979:0:7121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932985:0:7121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932990:0:7121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.932994:0:7121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390151.932996:0:7121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.933001:0:7121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.933006:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf50629be00) 00010000:00010000:2.0:1785390151.933008:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390151.933016:0:7121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.933021:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5edbf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.933069:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d400/0x33dffe75ff5edbe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2dc expref: 27 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.933081:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2dc expref: 26 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390151.933088:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:2.0:1785390151.933091:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390151.933093:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c400, rc 0) 00000100:00100000:2.0:1785390151.933121:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11614:x1872116847841152:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 13208us (13493us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390151.933127:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 232 00010000:00010000:3.0:1785390152.150731:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390152.214800:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390152.214836:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879290880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390152.214930:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390152.215202:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879290880 00000100:00100000:1.0:1785390152.215213:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879290880 00000100:00100000:1.0:1785390152.215274:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1785390152.215284:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879290880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390152.215312:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1785390152.215369:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879290880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390152.215376:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1785390152.215505:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879290880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390152.735737:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879291008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390152.735833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390152.736077:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291008 00000100:00100000:2.0:1785390152.736087:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291008 00000100:00100000:2.0:1785390152.736156:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1785390152.736166:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1872116879291008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390152.736221:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390152.736275:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1872116879291008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390152.736281:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1785390152.737465:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390152.737517:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879291008:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1785390152.913618:0:12489:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785390152.920480:0:12489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785390152.920998:0:12489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1785390152.921008:0:12489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1785390152.922687:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1785390152.922697:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1785390152.925159:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1785390152.925173:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1785390152.925312:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d48a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879291136:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1785390152.925432:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf52367a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390152.930508:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d48a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11557:1872116879291136:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785390152.930594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390152.930755:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847841664 00000100:00100000:3.0:1785390152.930765:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847841664 00000100:00100000:3.0:1785390152.930848:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:3.0:1785390152.930861:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11625:x1872116847841664:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1785390152.930905:0:5802:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1785390152.931023:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11625:x1872116847841664:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 164us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390152.931031:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00080000:2.0:1785390152.932885:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390152.934791:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390152.934902:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847841920 00000100:00100000:3.0:1785390152.934913:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847841920 00000100:00100000:3.0:1785390152.934983:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:3.0:1785390152.934993:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+26:11625:x1872116847841920:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1785390152.935018:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390152.935044:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2e3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.935268:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5edc08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.935285:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5edc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.935311:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5edc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390152.935324:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1785390152.935475:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2e3 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.935494:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5edc08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2e3 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.935503:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390152.935507:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390152.935647:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5600, rc 0) 00000100:00100000:1.0:1785390152.936763:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:11625:x1872116847841920:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1767us (1974us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1785390152.936772:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 234 00000100:00100000:1.0:1785390152.945954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390152.946342:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847842176 00000100:00100000:3.0:1785390152.946355:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847842176 00000100:00100000:3.0:1785390152.946430:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 235 00000100:00100000:3.0:1785390152.946442:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:11625:x1872116847842176:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1785390152.946571:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946593:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946607:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946872:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946891:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946899:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946905:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390152.946911:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946919:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946933:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390152.946936:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1785390152.946941:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.946948:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4800/0x33dffe75ff5edc16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390152.947126:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:11625:x1872116847842176:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 686us (1185us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1785390152.947136:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 235 00000040:00080000:1.0:1785390152.948984:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1785390152.948991:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1785390152.949484:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1785390152.949494:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1785390152.953445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390152.953580:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847842304 00000100:00100000:3.0:1785390152.953592:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847842304 00000100:00100000:3.0:1785390152.953666:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:3.0:1785390152.953677:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e068850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:2357:x1872116847842304:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390152.953694:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390152.953736:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5600/0x33dffe75ff5edc08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2e3 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390152.953757:0:11040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390152.953762:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390152.953823:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e068850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:2357:x1872116847842304:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 148us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390152.953830:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1785390152.964455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390152.964563:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847842560 00000100:00100000:3.0:1785390152.964576:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847842560 00000100:00100000:3.0:1785390152.964650:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 64 00000100:00100000:3.0:1785390152.964663:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+28:11625:x1872116847842560:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785390152.964973:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:11625:x1872116847842560:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 313us (526us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1785390152.964983:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 64 00010000:00010000:3.0:1785390153.173759:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785390153.425097:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1785390153.425122:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1785390154.157321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390154.157356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390154.157397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390154.157422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390154.157443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390154.157468:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843200 00000100:00100000:1.0:1785390154.157476:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843200 00000100:00100000:1.0:1785390154.157555:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847842816 00000100:00100000:1.0:1785390154.157557:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847842816 00000100:00100000:1.0:1785390154.157578:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:1.0:1785390154.157586:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847843200:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390154.157662:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847843200:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390154.157669:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 213 00000100:00100000:1.0:1785390154.157685:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:1.0:1785390154.157691:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:2358:x1872116847842816:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390154.157713:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:2358:x1872116847842816:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390154.157719:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 214 00000100:00100000:1.0:1785390154.157733:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847842944 00000100:00100000:1.0:1785390154.157736:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847842944 00000100:00100000:1.0:1785390154.157756:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843072 00000100:00100000:1.0:1785390154.157758:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843072 00000100:00100000:1.0:1785390154.157772:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:1.0:1785390154.157777:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847842944:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390154.157820:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847842944:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 43us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390154.157827:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 126 00000100:00100000:1.0:1785390154.157837:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1785390154.157843:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847843072:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390154.157859:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847843072:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 17us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390154.157865:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00080000:2.0:1785390154.158023:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390154.158027:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1785390154.158029:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390154.158472:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847842688 00000100:00100000:3.0:1785390154.158478:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847842688 00000100:00100000:3.0:1785390154.158513:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 322 00000100:00100000:3.0:1785390154.158519:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847842688:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390154.158691:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847842688:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 172us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390154.158696:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 322 00010000:00010000:1.0:1785390154.202479:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390155.221939:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785390155.446821:0:12542:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390155.446831:0:12542:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390155.446881:0:12542:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1785390155.446887:0:12542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1785390155.711413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390155.711442:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843456 00000100:00100000:1.0:1785390155.711451:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843456 00000100:00100000:1.0:1785390155.711493:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:1.0:1785390155.711501:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+29:11647:x1872116847843456:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:1.0:1785390155.711520:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390155.711557:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4200/0x33dffe75ff5edc1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2ea expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390155.711666:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5edc24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390155.711681:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5edc24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390155.711693:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5edc24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390155.711719:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1785390155.712113:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4200/0x33dffe75ff5edc1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ea expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390155.712130:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5edc24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ea expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390155.712138:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390155.712141:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785390155.712145:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4000, rc 0) 00000100:00100000:1.0:1785390155.712198:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:11647:x1872116847843456:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 696us (789us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1785390155.712205:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 236 00000100:00100000:3.0:1785390155.719158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390155.719188:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843584 00000100:00100000:3.0:1785390155.719196:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843584 00000100:00100000:3.0:1785390155.719255:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:3.0:1785390155.719264:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:11647:x1872116847843584:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:3.0:1785390155.719325:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719344:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719371:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719395:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719402:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719410:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719416:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390155.719420:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719428:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719438:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:3.0:1785390155.719441:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390155.719446:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390155.719462:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5800/0x33dffe75ff5edc32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390155.719520:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+31:11647:x1872116847843584:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 257us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390155.719543:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 237 00000100:00100000:1.0:1785390155.925032:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390155.929757:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843712 00000100:00100000:0.0:1785390155.929772:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843712 00000100:00100000:0.0:1785390155.929881:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:0.0:1785390155.929893:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847843712:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1785390155.930109:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390155.930131:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5edc39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2f1 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390155.930159:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a6ae446, atime: 0x6a6ae446, ctime: 0x6a6ae446, blocks: 0xb 00010000:00010000:0.0:1785390155.930179:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1785390155.930183:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390155.930192:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5edc39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2f1 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390155.930210:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5edc39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2f1 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390155.930241:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717800, rc 0) 00000100:00100000:0.0:1785390155.930372:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2358:x1872116847843712:12345-192.168.202.54@tcp:101:cat.0 Request processed in 481us (5349us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390155.930379:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 72 00000100:00100000:2.0:1785390155.954145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390155.954312:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843840 00000100:00100000:1.0:1785390155.954322:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843840 00002000:00100000:1.0:1785390155.954366:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8cf53fc00000 x1872116847843840/t0(0) o3->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:141/0 lens 488/0 e 0 to 0 dl 1785390166 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390155.954378:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fc00000 with x1872116847843840 ext(0->4095) 00002000:00010000:1.0:1785390155.954384:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53fc00000 00000100:00100000:1.0:1785390155.954413:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1785390155.954421:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847843840:12345-192.168.202.54@tcp:3:cat.0 00000100:00100000:1.0:1785390155.954889:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+8:2360:x1872116847843840:12345-192.168.202.54@tcp:3:cat.0 Request processed in 467us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1785390155.954897:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00002000:00100000:1.0:1785390155.954918:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8cf53fc00000 x1872116847843840/t0(0) o3->db9e37b8-1bb4-4113-a95f-cdba66461e5f@192.168.202.54@tcp:141/0 lens 488/4536 e 0 to 0 dl 1785390166 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1785390155.954927:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fc00000 with x1872116847843840 ext(0->4095) 00002000:00010000:1.0:1785390155.954930:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53fc00000 00010000:00010000:1.0:1785390156.246301:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390156.822621:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879291264:0@lo:400:kworker.0 00000100:00100000:2.0:1785390156.822693:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390156.822758:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879291776:0@lo:400:kworker.0 00000100:00100000:2.0:1785390156.822793:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390156.822827:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390156.822833:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879291648:0@lo:400:kworker.0 00000100:00100000:2.0:1785390156.822858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390156.822888:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291648 00000100:00100000:2.0:1785390156.822895:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291648 00000100:00100000:2.0:1785390156.822948:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1785390156.822957:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879291648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390156.823004:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879291648:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390156.823011:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1785390156.823038:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390156.823060:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1785390156.823065:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1785390156.823084:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf541d4c700, transno 4294967310 00000100:00100000:2.0:1785390156.823095:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879291648:0@lo:400:kworker.0 00000100:00100000:0.0:1785390156.823332:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879291392:0@lo:400:kworker.0 00000100:00100000:0.0:1785390156.823365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390156.823398:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879291904:0@lo:400:kworker.0 00000100:00100000:0.0:1785390156.823418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390156.823436:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390156.823442:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879291520:0@lo:400:kworker.0 00000100:00100000:0.0:1785390156.823462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390156.823489:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291904 00000100:00100000:0.0:1785390156.823493:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291904 00000100:00100000:0.0:1785390156.823547:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1785390156.823554:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390156.823603:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879291904:12345-0@lo:400:kworker.0 Request processed in 50us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390156.823610:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1785390156.823627:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785390156.823653:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879291904:0@lo:400:kworker.0 00000100:00100000:1.0:1785390156.823725:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291264 00000100:00100000:1.0:1785390156.823730:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291264 00000100:00100000:1.0:1785390156.823765:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1785390156.823771:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879291264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390156.823837:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879291264:12345-0@lo:400:kworker.0 Request processed in 66us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390156.823844:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1785390156.823873:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291776 00000100:00100000:1.0:1785390156.823876:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291776 00000100:00100000:1.0:1785390156.823900:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291392 00000100:00100000:1.0:1785390156.823902:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291392 00000100:00100000:1.0:1785390156.823912:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879291520 00000100:00100000:1.0:1785390156.823914:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879291520 00000100:00100000:1.0:1785390156.823927:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1785390156.823932:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879291776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390156.823964:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879291776:12345-0@lo:400:kworker.0 Request processed in 30us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390156.823969:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1785390156.823980:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1785390156.823985:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879291392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390156.824011:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879291392:12345-0@lo:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390156.824032:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1785390156.824043:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785390156.824048:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879291520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390156.824075:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879291520:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390156.824079:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1785390156.824102:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879291264:0@lo:400:kworker.0 00000100:00100000:1.0:1785390156.824111:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879291776:0@lo:400:kworker.0 00000100:00080000:0.0:1785390156.826076:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390156.826112:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879291520:0@lo:400:kworker.0 00000100:00100000:0.0:1785390156.826123:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879291392:0@lo:400:kworker.0 00000001:00080000:0.0:1785390156.964017:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1785390156.964035:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1785390156.965968:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:3.0:1785390156.965997:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1785390156.966067:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf5183d7f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1785390156.966074:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf535a49500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf5183d7900 00000020:00080000:3.0:1785390156.966078:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf535a49600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf50698d000 00000020:00080000:0.0:1785390156.966717:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1785390156.966913:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1785390157.272131:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390157.334058:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879292032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390157.334135:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390157.334203:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292032 00000100:00100000:2.0:1785390157.334209:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292032 00000100:00100000:2.0:1785390157.334247:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785390157.334255:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879292032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390157.334287:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390157.334322:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879292032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390157.334330:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1785390157.334364:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1785390157.334369:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1785390157.334407:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879292032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390157.848785:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390157.848820:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879292160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390157.848909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390157.848987:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292160 00000100:00100000:2.0:1785390157.848996:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292160 00000100:00100000:2.0:1785390157.849049:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1785390157.849059:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879292160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390157.849102:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390157.849152:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879292160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390157.849161:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1785390157.849220:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879292160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1785390158.311423:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390159.283958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390159.284006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390159.284040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390159.284076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390159.284105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390159.284142:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844480 00000100:00100000:3.0:1785390159.284154:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844480 00000100:00100000:3.0:1785390159.284222:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844096 00000100:00100000:3.0:1785390159.284225:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844096 00000100:00100000:3.0:1785390159.284250:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00100000:3.0:1785390159.284261:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847844480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390159.284272:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:0.0:1785390159.284281:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2358:x1872116847844096:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390159.284350:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2358:x1872116847844096:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390159.284357:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 219 00000100:00100000:0.0:1785390159.284384:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844224 00000100:00100000:0.0:1785390159.284387:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844224 00000100:00100000:0.0:1785390159.284418:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844352 00000100:00100000:0.0:1785390159.284421:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844352 00000100:00100000:0.0:1785390159.284443:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:0.0:1785390159.284449:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847844224:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390159.284517:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 131 00000100:00100000:2.0:1785390159.284560:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847844352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390159.285062:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+5:2358:x1872116847844480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 802us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390159.285069:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 218 00000100:00080000:3.0:1785390159.285238:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390159.285250:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785390159.285253:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390159.287710:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847843968 00000100:00100000:1.0:1785390159.287725:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847843968 00000100:00100000:1.0:1785390159.287789:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 324 00000100:00100000:1.0:1785390159.287800:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847843968:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390159.287881:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847843968:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 82us (3937us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390159.287888:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 324 00000100:00100000:0.0:1785390159.298888:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847844224:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 14419us (14861us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390159.298907:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 130 00000100:00100000:2.0:1785390159.302433:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847844352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 17892us (18311us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390159.302449:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 131 00010000:00010000:1.0:1785390159.319170:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390160.343672:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390161.365967:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390161.944981:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879292672:0@lo:400:kworker.0 00000100:00100000:3.0:1785390161.945074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390161.945161:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879292288:0@lo:400:kworker.0 00000100:00100000:1.0:1785390161.945201:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390161.951699:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292288 00000100:00100000:1.0:1785390161.951720:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292288 00000100:00100000:1.0:1785390161.951825:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1785390161.951838:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879292288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390161.951959:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879292288:12345-0@lo:400:kworker.0 Request processed in 124us (6757us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390161.951967:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1785390161.952215:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292672 00000100:00100000:1.0:1785390161.952221:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292672 00000100:00100000:0.0:1785390161.953597:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879292544:0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.953656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390161.953704:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1785390161.953713:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879292416:0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.953745:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390161.953767:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879292928:0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.954084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390161.954120:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292544 00000100:00100000:0.0:1785390161.954125:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292544 00000100:00100000:0.0:1785390161.954168:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292416 00000100:00100000:0.0:1785390161.954170:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292416 00000100:00100000:0.0:1785390161.954191:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1785390161.954199:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879292544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.954260:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879292544:12345-0@lo:400:kworker.0 Request processed in 61us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390161.954268:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1785390161.954283:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1785390161.954290:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879292416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.954318:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879292416:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390161.954324:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1785390161.954366:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879292416:0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.954378:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879292544:0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.954430:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292928 00000100:00100000:0.0:1785390161.954433:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292928 00000100:00100000:0.0:1785390161.954461:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1785390161.954467:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879292928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390161.954679:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879292928:12345-0@lo:400:kworker.0 Request processed in 211us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390161.954686:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1785390161.954712:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879292928:0@lo:400:kworker.0 00000100:00080000:0.0:1785390161.954759:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390161.954765:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785390161.955767:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390161.955872:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1785390161.955881:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879292672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390161.955931:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879292672:12345-0@lo:400:kworker.0 Request processed in 52us (10858us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390161.955938:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1785390161.955984:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879292288:0@lo:400:kworker.0 00000100:00100000:1.0:1785390161.955995:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879292800:0@lo:400:kworker.0 00000100:00100000:1.0:1785390161.956024:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390161.956066:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879292800 00000100:00100000:1.0:1785390161.956071:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879292800 00000100:00100000:1.0:1785390161.956096:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1785390161.956101:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879292800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390161.956135:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879292800:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390161.956141:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1785390161.956152:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390161.956166:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879292800:0@lo:400:kworker.0 00000100:00100000:3.0:1785390161.960631:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879292672:0@lo:400:kworker.0 00000020:00080000:1.0:1785390162.018501:0:5824:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1785390162.018685:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1785390162.018712:0:5835:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1785390162.199896:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390162.199906:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390162.200357:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1785390162.200364:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1785390162.391722:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390162.453909:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390162.454005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390162.454150:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293056 00000100:00100000:0.0:1785390162.454159:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293056 00000100:00100000:0.0:1785390162.454223:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1785390162.454235:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879293056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1785390162.454281:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390162.454342:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879293056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390162.454349:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1785390162.454556:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53f7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390162.965700:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785390162.965740:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879293184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390162.965840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390162.965999:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293184 00000100:00100000:2.0:1785390162.966009:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293184 00000100:00100000:2.0:1785390162.966073:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1785390162.966084:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879293184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390162.966128:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390162.966186:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879293184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390162.966194:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1785390162.966247:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879293184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390163.421621:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390163.778164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390163.778334:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844608 00000100:00100000:1.0:1785390163.778348:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844608 00000100:00100000:1.0:1785390163.778437:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00100000:1.0:1785390163.778451:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11291:x1872116847844608:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1785390163.778660:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11291:x1872116847844608:12345-192.168.202.54@tcp:60:lhsmtool_posix.0 Request processed in 212us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390163.778668:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 238 00000100:00080000:2.0:1785390163.778914:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390163.787747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390163.788822:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844864 00000100:00100000:3.0:1785390163.788837:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844864 00000100:00100000:3.0:1785390163.788917:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:3.0:1785390163.788928:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:11291:x1872116847844864:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1785390163.789883:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:11291:x1872116847844864:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 952us (2146us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1785390163.789893:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 65 00000100:00100000:3.0:1785390164.028917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390164.029083:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847844992 00000100:00100000:1.0:1785390164.029095:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847844992 00000100:00100000:1.0:1785390164.029224:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:1.0:1785390164.029237:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:12098:x1872116847844992:12345-192.168.202.54@tcp:101:lsof.0 00010000:00010000:1.0:1785390164.029265:0:7121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390164.029303:0:7121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5600/0x33dffe75ff5edc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c2f8 expref: -99 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390164.029504:0:7121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edc47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785390164.029569:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1785390164.029579:0:7121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390164.029598:0:7121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390164.030170:0:7121:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1785390164.030176:0:7121:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390164.030261:0:7121:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7121 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390164.030294:0:7121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5600/0x33dffe75ff5edc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2f8 expref: 7 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390164.030326:0:7121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2f8 expref: 6 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390164.030337:0:7121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:0.0:1785390164.030346:0:7121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390164.030351:0:7121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5800, rc 0) 00000100:00100000:0.0:1785390164.030577:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:12098:x1872116847844992:12345-192.168.202.54@tcp:101:lsof.0 Request processed in 1342us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390164.030587:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 239 00000100:00100000:0.0:1785390164.398919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390164.398979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390164.399023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390164.399060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390164.399098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390164.399155:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845120 00000100:00100000:1.0:1785390164.399168:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845120 00000100:00100000:3.0:1785390164.399177:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845632 00000100:00100000:3.0:1785390164.399184:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845632 00000100:00100000:3.0:1785390164.399228:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845248 00000100:00100000:3.0:1785390164.399232:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845248 00000100:00100000:1.0:1785390164.399237:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 326 00000100:00100000:1.0:1785390164.399251:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847845120:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390164.399262:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:3.0:1785390164.399272:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+6:2357:x1872116847845632:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390164.399360:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d495bf-c139-42e4-8792-c92077fd09ad+6:2357:x1872116847845632:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390164.399369:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 223 00000100:00100000:3.0:1785390164.400432:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 224 00000100:00100000:3.0:1785390164.400444:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:2358:x1872116847845248:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390164.409328:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847845120:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 10065us (10407us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390164.409344:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 326 00000100:00100000:2.0:1785390164.409975:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845376 00000100:00100000:2.0:1785390164.409988:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845376 00000100:00100000:2.0:1785390164.410066:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845504 00000100:00100000:2.0:1785390164.410070:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845504 00000100:00100000:2.0:1785390164.410099:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:2.0:1785390164.410110:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847845376:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390164.410169:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2357:x1872116847845376:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 61us (11189us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390164.410176:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 134 00000100:00100000:2.0:1785390164.410191:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00100000:2.0:1785390164.410216:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847845504:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390164.410245:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847845504:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 30us (11147us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390164.410251:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 135 00000100:00080000:2.0:1785390164.410277:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1785390164.410282:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390164.410971:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:2358:x1872116847845248:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 10525us (11905us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390164.410983:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 224 00010000:00010000:3.0:1785390164.437817:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390165.464843:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390166.488629:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390167.066045:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879293312:0@lo:400:kworker.0 00000100:00100000:2.0:1785390167.066137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390167.066211:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879293824:0@lo:400:kworker.0 00000100:00100000:2.0:1785390167.066242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390167.066273:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390167.066279:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879293696:0@lo:400:kworker.0 00000100:00100000:2.0:1785390167.066311:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390167.066345:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293696 00000100:00100000:2.0:1785390167.066354:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293696 00000100:00100000:2.0:1785390167.066435:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1785390167.066445:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879293696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390167.066514:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e12df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879293696:12345-0@lo:400:kworker.0 Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390167.066549:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1785390167.066580:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390167.066615:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879293696:0@lo:400:kworker.0 00000100:00100000:0.0:1785390167.083851:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293312 00000100:00100000:0.0:1785390167.083873:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293312 00000100:00100000:1.0:1785390167.089978:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293824 00000100:00100000:1.0:1785390167.089996:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293824 00000100:00100000:1.0:1785390167.090072:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1785390167.090088:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879293824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.090230:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879293824:12345-0@lo:400:kworker.0 Request processed in 139us (23978us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390167.090238:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1785390167.090264:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390167.090306:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879293824:0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.090364:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879293568:0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.090403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390167.090442:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1785390167.090449:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879293440:0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.090471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390167.090491:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879293952:0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.090550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390167.090595:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293568 00000100:00100000:1.0:1785390167.090599:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293568 00000100:00100000:1.0:1785390167.090623:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293440 00000100:00100000:1.0:1785390167.090625:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293440 00000100:00100000:1.0:1785390167.090639:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1785390167.090645:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879293568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.090677:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879293568:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390167.090683:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1785390167.090998:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1785390167.091005:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879293440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.091034:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879293440:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390167.091039:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1785390167.091057:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879293952 00000100:00100000:1.0:1785390167.091060:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879293952 00000100:00100000:1.0:1785390167.091093:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1785390167.091100:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879293952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.091129:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879293952:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390167.091135:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1785390167.091275:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879293440:0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.091288:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879293952:0@lo:400:kworker.0 00000100:00100000:1.0:1785390167.091296:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879293568:0@lo:400:kworker.0 00000100:00080000:1.0:1785390167.091316:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785390167.091318:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390167.091865:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1785390167.091874:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879293312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390167.091922:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879293312:12345-0@lo:400:kworker.0 Request processed in 49us (25785us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390167.091929:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1785390167.091967:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879293312:0@lo:400:kworker.0 00000001:00080000:1.0:1785390167.216117:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:1.0:1785390167.511207:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390167.574262:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879294080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390167.574364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390167.574785:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294080 00000100:00100000:2.0:1785390167.574796:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294080 00000100:00100000:2.0:1785390167.574856:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1785390167.574867:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879294080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390167.574933:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390167.574996:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879294080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390167.575005:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1785390167.575100:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879294080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390168.087260:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879294208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390168.087356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390168.087560:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294208 00000100:00100000:3.0:1785390168.087571:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294208 00000100:00100000:3.0:1785390168.087636:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785390168.087647:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879294208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390168.087701:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390168.087761:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879294208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390168.087769:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1785390168.087824:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879294208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390168.540730:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785390168.916859:0:12745:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:42:47 (1785390167) 00000100:00100000:3.0:1785390169.517791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390169.517830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390169.517863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390169.517883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390169.517919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390169.517952:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847846272 00000100:00100000:3.0:1785390169.517963:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847846272 00000100:00100000:3.0:1785390169.518033:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845888 00000100:00100000:3.0:1785390169.518037:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845888 00000100:00100000:3.0:1785390169.518073:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:3.0:1785390169.518083:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+6:2358:x1872116847846272:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390169.518179:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d495bf-c139-42e4-8792-c92077fd09ad+6:2358:x1872116847846272:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 97us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390169.518188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 228 00000100:00100000:3.0:1785390169.518209:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:3.0:1785390169.518217:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2358:x1872116847845888:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390169.518270:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:2358:x1872116847845888:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 53us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390169.518277:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 229 00000100:00100000:3.0:1785390169.518300:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847846016 00000100:00100000:3.0:1785390169.518303:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847846016 00000100:00100000:3.0:1785390169.518330:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847846144 00000100:00100000:3.0:1785390169.518332:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847846144 00000100:00100000:3.0:1785390169.518355:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:3.0:1785390169.518360:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847846016:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390169.518382:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2358:x1872116847846016:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390169.518386:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 138 00000100:00100000:3.0:1785390169.518392:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00100000:3.0:1785390169.518396:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847846144:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390169.518410:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2358:x1872116847846144:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 14us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390169.518413:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 139 00000100:00080000:3.0:1785390169.518425:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1785390169.518433:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785390169.518435:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390169.518830:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847845760 00000100:00100000:1.0:1785390169.518835:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847845760 00000100:00100000:1.0:1785390169.518873:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 328 00000100:00100000:1.0:1785390169.518880:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847845760:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390169.518916:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2358:x1872116847845760:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 37us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390169.518923:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 328 00010000:00010000:1.0:1785390169.558914:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390170.582656:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390171.605905:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390172.183275:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879294720:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.183371:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390172.183483:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1785390172.183490:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879294336:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.183541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390172.183571:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879294848:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.183598:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390172.183618:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294720 00000100:00100000:2.0:1785390172.183629:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294720 00000100:00100000:3.0:1785390172.183681:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294848 00000100:00100000:3.0:1785390172.183686:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294848 00000100:00100000:2.0:1785390172.183709:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1785390172.183721:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879294720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.183727:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1785390172.183738:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879294848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.183799:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879294848:12345-0@lo:400:kworker.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390172.183805:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879294720:12345-0@lo:400:kworker.0 Request processed in 85us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390172.183812:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1785390172.183818:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1785390172.183840:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785390172.183846:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390172.183850:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879294592:0@lo:400:kworker.0 00000100:00100000:2.0:1785390172.183909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390172.183939:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785390172.183948:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879294464:0@lo:400:kworker.0 00000100:00100000:2.0:1785390172.183981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390172.184019:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879294976:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.184158:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294592 00000100:00100000:3.0:1785390172.184162:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294592 00000100:00100000:3.0:1785390172.184186:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294464 00000100:00100000:3.0:1785390172.184188:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294464 00000100:00100000:3.0:1785390172.184202:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1785390172.184207:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879294592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.184240:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879294592:12345-0@lo:400:kworker.0 Request processed in 32us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390172.184246:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1785390172.184256:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1785390172.184269:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879294464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.184293:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879294464:12345-0@lo:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390172.184299:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:3.0:1785390172.184318:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390172.184357:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879294848:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.184367:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879294720:0@lo:400:kworker.0 00000100:00100000:0.0:1785390172.185052:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294336 00000100:00100000:0.0:1785390172.185058:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294336 00000100:00100000:0.0:1785390172.185094:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1785390172.185101:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879294336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390172.185150:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3309:x1872116879294336:12345-0@lo:400:kworker.0 Request processed in 49us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390172.185168:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1785390172.185418:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879294336:0@lo:400:kworker.0 00000100:00100000:2.0:1785390172.186292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390172.186340:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879294976 00000100:00100000:3.0:1785390172.186346:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879294976 00000100:00100000:2.0:1785390172.186367:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879294592:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.186393:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1785390172.186396:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879294464:0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.186405:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879294976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390172.186473:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879294976:12345-0@lo:400:kworker.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00080000:2.0:1785390172.186479:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785390172.186548:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1785390172.186592:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879294976:0@lo:400:kworker.0 00000040:00080000:0.0:1785390172.437846:0:11557:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1785390172.437861:0:11557:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1785390172.438728:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1785390172.438739:0:11557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1785390172.633028:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390172.698155:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879295104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390172.698230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390172.698601:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295104 00000100:00100000:2.0:1785390172.698610:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295104 00000100:00100000:2.0:1785390172.698682:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1785390172.698692:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879295104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390172.698746:0:6600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390172.701966:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879295104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3267us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390172.701981:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1785390172.705915:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879295104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390173.210506:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879295232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390173.210626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390173.211131:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295232 00000100:00100000:2.0:1785390173.211141:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295232 00000100:00100000:2.0:1785390173.211195:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1785390173.211204:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879295232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390173.211241:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390173.211294:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879295232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390173.211301:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1785390173.215890:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879295232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390173.653760:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390173.768697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390173.770346:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847846528 00000100:00100000:1.0:1785390173.770358:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847846528 00000100:00100000:1.0:1785390173.770446:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00100000:1.0:1785390173.770459:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+18:12320:x1872116847846528:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:1.0:1785390173.770968:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:12320:x1872116847846528:12345-192.168.202.54@tcp:35:umount.0 Request processed in 511us (2279us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1785390173.770975:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 66 00000100:00080000:2.0:1785390173.771431:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390173.774332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390173.775164:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847846784 00000100:00100000:1.0:1785390173.775173:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847846784 00000100:00100000:1.0:1785390173.775223:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:1.0:1785390173.775232:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+19:12320:x1872116847846784:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:1.0:1785390173.776762:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:12320:x1872116847846784:12345-192.168.202.54@tcp:35:umount.0 Request processed in 1525us (2432us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1785390173.776772:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 67 00000100:00100000:0.0:1785390173.790222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390173.790299:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847847040 00000100:00100000:3.0:1785390173.790309:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847847040 00000100:00100000:3.0:1785390173.790361:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:3.0:1785390173.790370:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508787c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+20:12320:x1872116847847040:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:3.0:1785390173.790879:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508787c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:12320:x1872116847847040:12345-192.168.202.54@tcp:35:umount.0 Request processed in 508us (665us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1785390173.790893:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 68 00000100:00100000:2.0:1785390173.804174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390173.804284:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847847296 00000100:00100000:3.0:1785390173.804295:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847847296 00000100:00100000:3.0:1785390173.804348:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:3.0:1785390173.804358:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:12320:x1872116847847296:12345-192.168.202.54@tcp:35:umount.0 00000100:00100000:3.0:1785390173.805746:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:12320:x1872116847847296:12345-192.168.202.54@tcp:35:umount.0 Request processed in 1385us (1578us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1785390173.805754:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 69 00000100:00100000:2.0:1785390173.815316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390173.815353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390173.815374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390173.815460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390173.815490:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847848064 00000100:00100000:2.0:1785390173.815499:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847848064 00000100:00100000:2.0:1785390173.815578:0:7936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00100000:2.0:1785390173.815588:0:7936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+7:2356:x1872116847848064:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:2.0:1785390173.815626:0:7936:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ed1f8 00000020:00010000:2.0:1785390173.815637:0:7936:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cf5034c6800: total 0 00000100:00080000:2.0:1785390173.815642:0:7936:0:(import.c:65:import_set_state_nolock()) ffff8cf5034c3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785390173.815677:0:7936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1785390173.815937:0:7936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2356:x1872116847848064:12345-192.168.202.54@tcp:9:umount.0 Request processed in 350us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390173.815945:0:7936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 73 00000100:00080000:2.0:1785390173.815966:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785390173.816331:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847847680 00000100:00100000:3.0:1785390173.816336:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847847680 00000100:00100000:3.0:1785390173.816376:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847847936 00000100:00100000:3.0:1785390173.816379:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847847936 00000100:00100000:3.0:1785390173.816389:0:11040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847847808 00000100:00100000:3.0:1785390173.816403:0:11040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847847808 00000100:00100000:3.0:1785390173.816418:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1785390173.816425:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+15:2357:x1872116847847680:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390173.816446:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390173.816464:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fc400/0x33dffe75ff5ecc5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be83 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390173.816482:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390173.816505:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+14:2357:x1872116847847680:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 80us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390173.816512:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:3.0:1785390173.816541:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1785390173.816548:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+13:2357:x1872116847847936:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390173.816561:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390173.816569:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5ecea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf4e expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390173.816579:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390173.816595:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+12:2357:x1872116847847936:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 48us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390173.816601:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1785390173.816735:0:11040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:3.0:1785390173.816746:0:11040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+11:2357:x1872116847847808:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390173.816754:0:11040:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390173.816763:0:11040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529600/0x33dffe75ff5ecc25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be4b expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390173.816773:0:11040:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390173.816789:0:11040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2357:x1872116847847808:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 46us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390173.816795:0:11040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000020:00010000:1.0:1785390173.817032:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cf5034c6800: total 0 00010000:00010000:1.0:1785390173.817066:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cf5034c6800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1785390173.817105:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d129cb/0x33dffe75ff5ed59b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c123 expref: 4 pid: 7936 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.817132:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a38614/0x33dffe75ff5edc39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2f1 expref: 3 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.817147:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cf5034c6800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1785390173.817156:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390173.817159:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390173.817160:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390173.826741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390173.826853:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847848192 00000100:00100000:3.0:1785390173.826863:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847848192 00000100:00100000:3.0:1785390173.826931:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 74 00000100:00100000:3.0:1785390173.826940:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+5:2356:x1872116847848192:12345-192.168.202.54@tcp:9:umount.0 00000020:00000080:3.0:1785390173.826971:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecf97 00000100:00080000:3.0:1785390173.826980:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf5034c7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785390173.827015:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1785390173.827288:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db9e37b8-1bb4-4113-a95f-cdba66461e5f+2:2356:x1872116847848192:12345-192.168.202.54@tcp:9:umount.0 Request processed in 348us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390173.827301:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 74 00010000:00010000:1.0:1785390173.827355:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785390173.828259:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390173.838600:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390173.838705:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847849216 00000100:00100000:3.0:1785390173.838722:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847849216 00000100:00100000:2.0:1785390173.838883:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 240 00000100:00100000:2.0:1785390173.838901:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf541d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+22:2356:x1872116847849216:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:2.0:1785390173.838935:0:7121:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecc33 00000020:00010000:2.0:1785390173.838952:0:7121:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cf510f93000: total 0 00000100:00080000:2.0:1785390173.838957:0:7121:0:(import.c:65:import_set_state_nolock()) ffff8cf510f96800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785390173.838985:0:7121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1785390173.839316:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf541d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db9e37b8-1bb4-4113-a95f-cdba66461e5f+21:2356:x1872116847849216:12345-192.168.202.54@tcp:39:umount.0 Request processed in 420us (724us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1785390173.839324:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 240 00000020:00010000:1.0:1785390173.839643:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cf510f93000: total 0 00010000:00010000:1.0:1785390173.839648:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390173.839691:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cf510f93000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1785390173.839721:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390173.839724:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785390173.839732:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ecf6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf78 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839750:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390173.839752:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390173.839756:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5000/0x33dffe75ff5edb1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2a4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839782:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390173.839784:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1785390173.839788:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4e00/0x33dffe75ff5ed619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c146 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839800:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390173.839802:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390173.839806:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ed47c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c0d6 expref: 17 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839817:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf50896ca00) 00010000:00010000:1.0:1785390173.839819:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1785390173.839822:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716c00/0x33dffe75ff5ecf19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf63 expref: 16 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839838:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:1.0:1785390173.839840:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390173.839843:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc5e00/0x33dffe75ff5ed5fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c13f expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839854:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390173.839856:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785390173.839859:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4000/0x33dffe75ff5edc24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2ea expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839871:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390173.839873:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390173.839881:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ed55c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c10e expref: 13 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839893:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf510c5a200) 00010000:00010000:1.0:1785390173.839895:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1785390173.839899:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ed586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c11c expref: 12 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839911:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf50629b700) 00010000:00010000:1.0:1785390173.839913:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1785390173.839917:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c400/0x33dffe75ff5edbfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2dc expref: 11 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839940:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:1.0:1785390173.839943:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785390173.839946:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf53ffc4400/0x33dffe75ff5ed25a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c04a expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839960:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf50629bc00) 00010000:00010000:1.0:1785390173.839962:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390173.839966:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d800/0x33dffe75ff5ecefd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf5c expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839978:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf520a1df00) 00010000:00010000:1.0:1785390173.839981:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1785390173.839984:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ed8f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c218 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390173.839997:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cf510f93000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1785390173.840012:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390173.840014:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390173.840016:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390174.637291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390174.637338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390174.637471:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847849472 00000100:00100000:0.0:1785390174.637482:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847849472 00000100:00100000:0.0:1785390174.637581:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:0.0:1785390174.637591:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:2358:x1872116847849472:12345-192.168.202.54@tcp:400:kworker.0 00000100:00080000:2.0:1785390174.637793:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390174.637864:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d495bf-c139-42e4-8792-c92077fd09ad+6:2358:x1872116847849472:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 273us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390174.637872:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 233 00000100:00100000:3.0:1785390174.638201:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847849344 00000100:00100000:3.0:1785390174.638206:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847849344 00000100:00100000:3.0:1785390174.638244:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 330 00000100:00100000:3.0:1785390174.638252:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847849344:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390174.638291:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2358:x1872116847849344:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390174.638299:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 330 00010000:00010000:1.0:1785390174.679592:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390175.692438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390175.692471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390175.692505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390175.692571:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847849600 00000100:00100000:1.0:1785390175.692581:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847849600 00000100:00100000:1.0:1785390175.692644:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847849856 00000100:00100000:1.0:1785390175.692648:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847849856 00000100:00100000:1.0:1785390175.692663:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847849728 00000100:00100000:1.0:1785390175.692665:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847849728 00000100:00100000:1.0:1785390175.692682:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1785390175.692697:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+12:2360:x1872116847849600:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390175.692718:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390175.692743:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529e00/0x33dffe75ff5ecd05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be98 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390175.692765:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390175.692821:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+11:2360:x1872116847849600:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390175.692829:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:1.0:1785390175.692845:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1785390175.692852:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+10:2360:x1872116847849856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390175.692860:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390175.692869:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ecea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bf47 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390175.692890:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390175.692916:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+9:2360:x1872116847849856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 64us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390175.692940:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1785390175.692954:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1785390175.692961:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+8:2360:x1872116847849728:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390175.692968:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390175.692976:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f5c00/0x33dffe75ff5ecd0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1bec2 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390175.692986:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390175.693004:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfce36af-778b-4771-80c2-03c6feec7bb9+7:2360:x1872116847849728:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 44us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390175.693011:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:2.0:1785390175.698033:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390175.698297:0:7121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847850112 00000100:00100000:3.0:1785390175.698307:0:7121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847850112 00000100:00100000:3.0:1785390175.698370:0:7121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 241 00000100:00100000:3.0:1785390175.698381:0:7121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+6:2356:x1872116847850112:12345-192.168.202.54@tcp:39:umount.0 00000020:00000080:3.0:1785390175.698430:0:7121:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecd1a 00000020:00010000:3.0:1785390175.698440:0:7121:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cf5356cd000: total 0 00000100:00080000:3.0:1785390175.698445:0:7121:0:(import.c:65:import_set_state_nolock()) ffff8cf5356cc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785390175.698473:0:7121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1785390175.698929:0:7121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d495bf-c139-42e4-8792-c92077fd09ad+5:2356:x1872116847850112:12345-192.168.202.54@tcp:39:umount.0 Request processed in 547us (904us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1785390175.698938:0:7121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 241 00000020:00010000:1.0:1785390175.699108:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cf5356cd000: total 0 00010000:00010000:1.0:1785390175.699154:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cf5356cd000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1785390175.699185:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf520a1dd00) 00010000:00010000:1.0:1785390175.699189:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390175.699196:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5800/0x33dffe75ff5edc47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c2f8 expref: 4 pid: 7121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390175.699221:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cf5356cd000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1785390175.699232:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390175.699234:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390175.699236:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390175.701906:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390175.724455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390175.724590:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847850368 00000100:00100000:3.0:1785390175.724599:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847850368 00000100:00100000:3.0:1785390175.724662:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 331 00000100:00100000:3.0:1785390175.724673:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+7:2356:x1872116847850368:12345-192.168.202.54@tcp:251:umount.0 00000020:00000080:3.0:1785390175.724719:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecc10 00000020:00010000:3.0:1785390175.724740:0:5798:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cf510f94800: total 0 00000100:00080000:3.0:1785390175.724744:0:5798:0:(import.c:65:import_set_state_nolock()) ffff8cf510f90800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1785390175.724814:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfce36af-778b-4771-80c2-03c6feec7bb9+3:2356:x1872116847850368:12345-192.168.202.54@tcp:251:umount.0 Request processed in 143us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390175.724822:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 331 00000020:00010000:1.0:1785390175.725119:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cf510f94800: total 0 00010000:00010000:1.0:1785390175.725124:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390175.725165:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cf510f94800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1785390175.725206:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501529000/0x33dffe75ff5ecc64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1be8a expref: 2 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390175.725221:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cf510f94800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1785390175.725232:0:5792:0:(genops.c:906:class_export_put()) final put ffff8cf510f94800/dfce36af-778b-4771-80c2-03c6feec7bb9 00010000:00010000:1.0:1785390175.725249:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390175.725251:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390175.725253:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1785390175.728792:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf510f94800/dfce36af-778b-4771-80c2-03c6feec7bb9 for MGS 00000020:00000080:3.0:1785390175.728856:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf510f90800 for MGS 00010000:00010000:1.0:1785390176.756693:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390177.305260:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf541d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879295360:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.305429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390177.305490:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879295872:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.305672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390177.305701:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785390177.305708:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879295744:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.305749:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390177.305780:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879295488:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.305806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390177.305825:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879296000:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.305846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390177.305865:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390177.305870:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879295616:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.305893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390177.305926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295360 00000100:00100000:0.0:1785390177.305933:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295360 00000100:00100000:0.0:1785390177.305976:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1785390177.305986:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879295360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.306034:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879295360:12345-0@lo:400:kworker.0 Request processed in 51us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390177.313229:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1785390177.313295:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295872 00000100:00100000:0.0:1785390177.313304:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295872 00000100:00100000:0.0:1785390177.313360:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295488 00000100:00100000:0.0:1785390177.313363:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295488 00000100:00100000:0.0:1785390177.313375:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295616 00000100:00100000:0.0:1785390177.313377:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295616 00000100:00100000:0.0:1785390177.313393:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785390177.313411:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879295872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.313496:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879295872:12345-0@lo:400:kworker.0 Request processed in 95us (7824us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390177.313503:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1785390177.313514:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1785390177.313542:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879295488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.313575:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879295488:12345-0@lo:400:kworker.0 Request processed in 35us (7768us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390177.313581:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1785390177.313592:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1785390177.313597:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879295616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.315701:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879295616:12345-0@lo:400:kworker.0 Request processed in 23us (7726us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390177.315715:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1785390177.315909:0:7936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879295744 00000100:00100000:0.0:1785390177.315917:0:7936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879295744 00000100:00100000:1.0:1785390177.318476:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296000 00000100:00100000:1.0:1785390177.318489:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296000 00000100:00100000:1.0:1785390177.318542:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1785390177.318553:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53596e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879295744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390177.318630:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53596e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879295744:12345-0@lo:400:kworker.0 Request processed in 79us (12881us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390177.318637:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1785390177.318775:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1785390177.318781:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879296000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390177.318806:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879296000:12345-0@lo:400:kworker.0 Request processed in 25us (12959us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390177.318812:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1785390177.319937:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390177.323610:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879295744:0@lo:400:kworker.0 00000100:00100000:1.0:1785390177.323626:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf541d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879295360:0@lo:400:kworker.0 00000100:00100000:1.0:1785390177.323639:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879295872:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.324631:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879295616:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.324645:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879295488:0@lo:400:kworker.0 00000100:00100000:0.0:1785390177.324655:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879296000:0@lo:400:kworker.0 00000100:00080000:0.0:1785390177.324677:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390177.324682:0:5799:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1785390177.395494:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:1.0:1785390177.395513:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000001:00080000:1.0:1785390177.395540:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1785390177.395546:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25d495bf-c139-42e4-8792-c92077fd09ad 00000001:00080000:1.0:1785390177.395552:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1785390177.395555:0:5824:0:(genops.c:906:class_export_put()) final put ffff8cf5356cd000/25d495bf-c139-42e4-8792-c92077fd09ad 00000020:00000080:1.0:1785390177.395572:0:5824:0:(genops.c:906:class_export_put()) final put ffff8cf510f93000/db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:0.0:1785390177.401079:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5356cd000/25d495bf-c139-42e4-8792-c92077fd09ad for lustre-MDT0000 00000020:00000080:0.0:1785390177.401169:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf510f93000/db9e37b8-1bb4-4113-a95f-cdba66461e5f for lustre-MDT0000 00000020:00000080:0.0:1785390177.401206:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf5356cc800 for lustre-MDT0000 00000020:00000080:0.0:1785390177.401211:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf510f96800 for lustre-MDT0000 00000001:00100000:0.0:1785390177.403422:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:0.0:1785390177.403429:0:7506:0:(genops.c:906:class_export_put()) final put ffff8cf5034c6800/db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:0.0:1785390177.403450:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5034c6800/db9e37b8-1bb4-4113-a95f-cdba66461e5f for lustre-OST0001 00000020:00000080:0.0:1785390177.403476:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf5034c3800 for lustre-OST0001 00010000:00010000:1.0:1785390177.750759:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390177.815432:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879296128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390177.815624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390177.815749:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296128 00000100:00100000:2.0:1785390177.815758:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296128 00000100:00100000:2.0:1785390177.815801:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1785390177.815809:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879296128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390177.815844:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390177.815898:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879296128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390177.815905:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1785390177.816585:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879296128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390178.329044:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879296256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390178.329140:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390178.331842:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296256 00000100:00100000:2.0:1785390178.331870:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296256 00000100:00100000:2.0:1785390178.331951:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1785390178.331964:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879296256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390178.332024:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390178.332115:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879296256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390178.332124:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1785390178.334772:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879296256:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1785390178.578765:0:12942:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1785390178.596623:0:12942:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1785390178.596691:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.596712:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.596721:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.596730:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.596752:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1785390178.596759:0:12942:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1785390178.596787:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1785390178.596793:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1785390178.596800:0:12942:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1785390178.596848:0:12942:0:(import.c:65:import_set_state_nolock()) ffff8cf52fdf2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1785390178.596902:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879296384:0@lo:39:umount.0 00000100:00100000:2.0:1785390178.597000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390178.597214:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296384 00000100:00100000:2.0:1785390178.597224:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296384 00010000:00010000:0.0:1785390178.597319:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390178.597327:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.597335:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:0.0:1785390178.597339:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.597349:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785390178.597357:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785390178.597363:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1785390178.597365:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1785390178.597367:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1785390178.597409:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.597416:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785390178.597434:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.597440:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf503716a00/0x33dffe75ff5ecca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eccaa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.597452:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390178.597454:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390178.597455:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390178.597497:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1785390178.597509:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872116879296384:12345-0@lo:39:umount.0 00000020:00000080:2.0:1785390178.597570:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5eca1f 00000100:00080000:2.0:1785390178.597579:0:5803:0:(import.c:65:import_set_state_nolock()) ffff8cf50dcd3800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1785390178.597650:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1872116879296384:12345-0@lo:39:umount.0 Request processed in 144us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390178.597659:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1785390178.597672:0:5803:0:(genops.c:906:class_export_put()) final put ffff8cf50dcd6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1785390178.597698:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf50dcd6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1785390178.597749:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf50dcd3800 for lustre-MDT0000 00000100:00080000:2.0:1785390178.597784:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf52fdf2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1785390178.597788:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879296512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785390178.597790:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879296384:0@lo:39:umount.0 00000100:00080000:2.0:1785390178.597810:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1785390178.597813:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1785390178.597817:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1785390178.597828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390178.597872:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296512 00000100:00100000:1.0:1785390178.597876:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296512 00000100:00100000:1.0:1785390178.597913:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785390178.597919:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50e06b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3310:x1872116879296512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390178.597930:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390178.597947:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5eccaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecca3 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.597961:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390178.597986:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50e06b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:3310:x1872116879296512:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390178.597992:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785390178.598077:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879296512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390178.600192:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390178.601404:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601426:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601435:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601454:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601515:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390178.601544:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601552:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601558:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.601565:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.611897:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785390178.611917:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.611940:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf501529800 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:0.0:1785390178.611945:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.611957:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785390178.611965:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785390178.611972:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1785390178.611975:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1785390178.612041:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612048:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785390178.612086:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612093:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf501529800/0x33dffe75ff5eccb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eccb8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612113:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390178.612118:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612124:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fce00 already unused, calling callback (ffffffffc1bbec20) 00000100:00100000:1.0:1785390178.612143:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:0.0:1785390178.612147:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612154:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1785390178.612159:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785390178.612164:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1785390178.612167:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:1.0:1785390178.612169:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879296640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390178.612179:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612184:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785390178.612190:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.612197:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390178.612198:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390178.612200:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390178.612255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390178.612332:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879296768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785390178.612354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390178.612404:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296640 00000100:00100000:1.0:1785390178.612413:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296640 00000100:00100000:1.0:1785390178.612467:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296768 00000100:00100000:1.0:1785390178.612471:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296768 00000100:00100000:1.0:1785390178.612498:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1785390178.612507:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+19:3308:x1872116879296640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390178.612521:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390178.612559:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5eccb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5eccb1 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.612575:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390178.612625:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+18:3308:x1872116879296640:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390178.612633:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1785390178.612652:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:1.0:1785390178.612655:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1785390178.612662:0:12942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5013fce00/0x33dffe75ff5ecbca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ecbd1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390178.612662:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+17:3308:x1872116879296768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390178.612670:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390178.612678:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501528600/0x33dffe75ff5ecbd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecbca expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390178.612686:0:12942:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1785390178.612690:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390178.612700:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390178.612712:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390178.612719:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3308:x1872116879296768:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (363us total) trans 0 rc 0/0 00010000:00010000:2.0:1785390178.612721:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390178.612725:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1785390178.612729:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.612744:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.612756:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390178.612762:0:12942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390178.612767:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879296768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785390178.612770:0:12942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390178.612775:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879296640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785390178.612777:0:12942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.612783:0:12942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.612793:0:12942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1785390178.612796:0:12942:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1785390178.612802:0:12942:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1785390178.612838:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785390178.612842:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390178.613033:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390178.613203:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785390178.613208:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.613218:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785390178.613237:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390178.613242:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1785390178.613245:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1785390178.613246:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000004:3.0:1785390178.613379:0:12942:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1785390178.613385:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1785390178.613400:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785390178.613409:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1785390178.613416:0:12942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8cf50e184000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785390178.613422:0:12942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8cf540ed7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1785390178.613427:0:12942:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8cf53a89b380) has exports, disconnecting them 00000020:00080000:3.0:1785390178.613432:0:12942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cf50e184000), last request at 1785390177 00000020:00000080:3.0:1785390178.613441:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb92 00000100:00080000:3.0:1785390178.613461:0:12942:0:(import.c:65:import_set_state_nolock()) ffff8cf50e183000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1785390178.613518:0:12942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf50e184000): rc 0 00000020:00000080:3.0:1785390178.613520:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf50e184000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1785390178.614268:0:12942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cf540ed7800), last request at 1785390177 00000020:00000080:3.0:1785390178.614273:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecac7 00000100:00080000:3.0:1785390178.614281:0:12942:0:(import.c:65:import_set_state_nolock()) ffff8cf53f549000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1785390178.614448:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390178.614457:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.614466:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf500030000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390178.614469:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.614477:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390178.614484:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390178.614490:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1785390178.614492:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1785390178.614495:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1785390178.614519:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.614548:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1785390178.614569:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.614575:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500030000/0x33dffe75ff5ec97e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ec985 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1785390178.614681:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf50e184000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1785390178.614749:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf50e183000 for lustre-MDT0000 00000020:00080000:3.0:1785390178.614811:0:12942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf540ed7800): rc 0 00000020:00000080:3.0:1785390178.614813:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf540ed7800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1785390178.614886:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390178.614888:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390178.614890:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390178.614905:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879297024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785390178.614979:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390178.615039:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879297024 00000100:00100000:1.0:1785390178.615046:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879297024 00000100:00100000:1.0:1785390178.615104:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785390178.615113:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+16:3309:x1872116879297024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390178.615125:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390178.615141:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf501528e00/0x33dffe75ff5ec985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ec97e expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390178.615157:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390178.615192:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:3309:x1872116879297024:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390178.615200:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785390178.615239:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879297024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390178.615258:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390178.615261:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1785390178.617109:0:12942:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac6641607ae0 00000100:00080000:3.0:1785390178.617145:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1785390178.617150:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1785390178.617173:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1785390178.617257:0:12942:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1785390178.617284:0:12942:0:(import.c:65:import_set_state_nolock()) ffff8cf503e36800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1785390178.617316:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1785390178.617319:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1785390178.617330:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1785390178.617422:0:12942:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1785390178.617433:0:12942:0:(import.c:65:import_set_state_nolock()) ffff8cf506043000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1785390178.617469:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8cf53a89b380) has no exports 00010000:00010000:2.0:1785390178.618078:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.618094:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785390178.618122:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.618130:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4a00/0x33dffe75ff5ececc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5eced3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390178.618162:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879297152:0@lo:9:umount.0 00000100:00100000:2.0:1785390178.618235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390178.618271:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879297280:0@lo:9:umount.0 00000100:00100000:2.0:1785390178.618295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390178.618339:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879296896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785390178.618367:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390178.618427:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879297280 00000100:00100000:1.0:1785390178.618427:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879297152 00000100:00100000:2.0:1785390178.618435:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879297280 00000100:00100000:1.0:1785390178.618435:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879297152 00000100:00100000:2.0:1785390178.618487:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1785390178.618497:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1872116879297280:12345-0@lo:9:umount.0 00000020:00000080:2.0:1785390178.618548:0:6597:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecc02 00000100:00080000:2.0:1785390178.618568:0:6597:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1785390178.618611:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1785390178.619422:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1872116879297280:12345-0@lo:9:umount.0 Request processed in 923us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390178.619430:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:00000080:0.0:1785390178.619433:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf540ed7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1785390178.619598:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1785390178.619608:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1872116879297152:12345-0@lo:9:umount.0 00000020:00000080:1.0:1785390178.619627:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb14 00000100:00080000:1.0:1785390178.619635:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8cf53b940800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1785390178.619676:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1785390178.619796:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3306:x1872116879297152:12345-0@lo:9:umount.0 Request processed in 189us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390178.619803:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1785390178.619826:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390178.626471:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879296896 00000100:00100000:2.0:1785390178.626492:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879296896 00000100:00100000:2.0:1785390178.626611:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785390178.626634:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+15:3310:x1872116879296896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785390178.626657:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390178.626683:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503716400/0x33dffe75ff5eced3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ececc expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390178.626706:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390178.626813:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19ebcf8f-53c9-4fee-a69e-b0198873419f+14:3310:x1872116879296896:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (8443us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390178.626821:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1785390178.626902:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf503e36800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1785390178.626920:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1785390178.626922:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785390178.626934:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879297152:0@lo:9:umount.0 00000100:00080000:2.0:1785390178.626951:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf506043000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1785390178.626958:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:19ebcf8f-53c9-4fee-a69e-b0198873419f:3310:1872116879296896:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1785390178.626961:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1785390178.626963:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785390178.626965:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879297280:0@lo:9:umount.0 00010000:00010000:2.0:1785390178.627006:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390178.627013:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390178.627027:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390178.627029:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785390178.628386:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf53f549000 for lustre-MDT0000 00000020:00080000:3.0:1785390178.644308:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8cf53a89b380) has no exports 00000020:00000080:3.0:1785390178.759136:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec9d9 00000020:00000080:3.0:1785390178.759150:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf540ed1800/lustre-QMT0000_UUID 00000020:01000000:3.0:1785390178.759171:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1785390178.759223:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf540ed1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1785390178.760047:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785390178.760126:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1785390178.760133:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8cf50e2c0000) has no exports 00000020:00000080:3.0:1785390178.765583:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec9d2 00000020:00000080:3.0:1785390178.765596:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf5183bd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1785390178.765661:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785390178.765672:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1785390178.765675:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf50dea1800/lustre-QMT0000_UUID 00000020:00000080:3.0:1785390178.765678:0:12942:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf50dea1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1785390178.765690:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1785390178.765879:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5183bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1785390178.766594:0:12942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf540f14f60 - data ffff8cf53f9deaf8/ffff8cf53fe9ac00 00000020:01000000:3.0:1785390178.766740:0:12942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf51826dd20 - data ffff8cf50fb18ca8/ffff8cf50dd08000 00010000:00010000:3.0:1785390178.775763:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1785390178.813465:0:12942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000001:00100000:3.0:1785390178.959682:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1785390178.959692:0:6622:0:(genops.c:906:class_export_put()) final put ffff8cf53b944800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1785390178.959716:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:3.0:1785390178.959718:0:6622:0:(genops.c:906:class_export_put()) final put ffff8cf5034c4800/db9e37b8-1bb4-4113-a95f-cdba66461e5f 00000020:00000080:3.0:1785390178.959733:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53b944800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1785390178.959775:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5034c4800/db9e37b8-1bb4-4113-a95f-cdba66461e5f for lustre-OST0000 00000020:00000080:3.0:1785390178.959789:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf53b940800 for lustre-OST0000 00000020:00000080:3.0:1785390178.959807:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf5034c7800 for lustre-OST0000 00000100:00080000:2.0:1785390178.974333:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1785390178.974341:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1785390178.974369:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785390178.974371:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1785390178.978690:0:6697:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1785390178.978700:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1785390178.978716:0:6697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1785390178.979875:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1785390178.979880:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1785390178.979891:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1785390178.979893:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1785390178.980151:0:7756:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1785390178.980154:0:7756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1785390178.980169:0:7756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1785390179.089431:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec9a1 00000020:00000080:1.0:1785390179.089442:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf535fe6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785390179.090713:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec9b6 00000020:00000080:1.0:1785390179.090720:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf535fe5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1785390179.090726:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1785390179.090730:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.090739:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1785390179.090743:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8cf53a8999c0) has no exports 00000004:01000000:1.0:1785390179.090897:0:12942:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1785390179.090905:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecbf4 00000020:00000080:1.0:1785390179.090909:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf51f0e2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1785390179.090913:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1785390179.090916:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.090921:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1785390179.090923:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8cf53f424d40) has no exports 00000020:00000080:1.0:1785390179.090928:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecbed 00000020:00000080:1.0:1785390179.090931:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf506044800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1785390179.091255:0:12942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1785390179.091259:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1785390179.091264:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1785390179.091270:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1785390179.091272:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1785390179.091308:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.091315:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1785390179.091320:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb0d 00000020:00000080:1.0:1785390179.091325:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf53f42e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1785390179.091328:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1785390179.091331:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.091334:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1785390179.091336:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8cf50ddf8000) has no exports 00000020:00000080:1.0:1785390179.091340:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb06 00000020:00000080:1.0:1785390179.091342:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf503e33800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1785390179.091708:0:12942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1785390179.091711:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1785390179.091713:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1785390179.091716:0:12942:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1785390179.091718:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1785390179.091743:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.091748:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1785390179.091768:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.091770:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1785390179.091795:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec9bd 00000020:00000080:1.0:1785390179.091799:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf535fe5800/lustre-MDD0000_UUID 00000020:01000000:1.0:1785390179.091802:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1785390179.091805:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.091808:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1785390179.091810:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8cf53a89cd40) has no exports 00000020:00000080:1.0:1785390179.091829:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.091831:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1785390179.091834:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec9c4 00000020:00000080:1.0:1785390179.091836:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf535fe7000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1785390179.091843:0:12942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf509225000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1785390179.091845:0:12942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf509225000 3 00000020:01000004:1.0:1785390179.091848:0:12942:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf509225000 from lustre-MDT0000 00000020:00000080:1.0:1785390179.091863:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.091870:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1785390179.091873:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf535fe7800/lustre-MDT0000_UUID 00000020:00000080:1.0:1785390179.091876:0:12942:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1785390179.091883:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1785390179.091935:0:12942:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1785390179.091939:0:12942:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1785390179.091941:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1785390179.091943:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.091945:0:12942:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1785390179.091951:0:12942:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8cf51982f800 19ebcf8f-53c9-4fee-a69e-b0198873419f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1785390179.091956:0:12942:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8cf50e2c4d40) has exports, disconnecting them 00000020:00080000:1.0:1785390179.091960:0:12942:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cf51982f800), last request at 1785389874 00000020:00000080:1.0:1785390179.091973:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec95b 00000020:00010000:1.0:1785390179.091977:0:12942:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cf51982f800: total 8 00000100:00080000:1.0:1785390179.091981:0:12942:0:(import.c:65:import_set_state_nolock()) ffff8cf50dea1000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1785390179.091997:0:12942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf51982f800): rc 0 00000020:00080000:1.0:1785390179.092001:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8cf50e2c4d40) has no exports 00000100:00100000:1.0:1785390179.092052:0:5795:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cf50dd02000:5795] 0 exiting: rc = 1 00000020:00010000:2.0:1785390179.092184:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cf51982f800: total 8 00010000:00010000:2.0:1785390179.092216:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cf51982f800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1785390179.092242:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5ecc80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecc79 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092257:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fd600/0x33dffe75ff5ecc72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecc6b expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092269:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f5000/0x33dffe75ff5ecc8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecc87 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092279:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503716600/0x33dffe75ff5ecc9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecc95 expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092291:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ecec5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5ecebe expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092301:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5013fda00/0x33dffe75ff5eca7a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5eca73 expref: 4 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092326:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121d600/0x33dffe75ff5eceb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5eceb0 expref: 3 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092339:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5eccc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33dffe75ff5eccbf expref: 2 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390179.092350:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cf51982f800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1785390179.092362:0:5791:0:(genops.c:906:class_export_put()) final put ffff8cf51982f800/19ebcf8f-53c9-4fee-a69e-b0198873419f 00010000:00010000:2.0:1785390179.092367:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390179.092369:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390179.092371:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785390179.095920:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785390179.095945:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1785390179.095951:0:8:0:(genops.c:906:class_export_put()) final put ffff8cf53a345000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785390179.095953:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53a345000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1785390179.095957:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785390179.096134:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf51f0e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1785390179.096139:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf506044800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785390179.096144:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf506043000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1785390179.096147:0:8:0:(genops.c:906:class_export_put()) final put ffff8cf535fe4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785390179.096149:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1785390179.096153:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785390179.096175:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53f42e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1785390179.096181:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf503e33800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785390179.096186:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf503e36800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1785390179.096190:0:8:0:(genops.c:906:class_export_put()) final put ffff8cf53f54b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785390179.096192:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53f54b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1785390179.096195:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785390179.096242:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1785390179.096246:0:8:0:(genops.c:906:class_export_put()) final put ffff8cf535fe0800/lustre-MDD0000_UUID 00000020:00000080:0.0:1785390179.096248:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1785390179.096251:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1785390179.096403:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1785390179.096407:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf51982f800/19ebcf8f-53c9-4fee-a69e-b0198873419f for MGS 00000020:00000080:0.0:1785390179.096439:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf50dea1000 for MGS 00000100:00100000:0.0:1785390179.096478:0:5797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cf50dd03a00:5797] 1 exiting: rc = 0 00000100:00100000:0.0:1785390179.096625:0:5798:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cf50dd03800:5798] 2 exiting: rc = 0 00000100:00100000:2.0:1785390179.105883:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105894:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105899:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105905:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105910:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105916:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105921:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105926:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105931:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105936:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105941:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105951:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105957:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105962:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105968:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105973:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105978:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105984:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105990:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.105995:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106015:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106021:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106026:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106031:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106037:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106042:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106047:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106053:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106058:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106063:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106068:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106073:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106078:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106082:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106087:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106092:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106097:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106101:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106106:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106112:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106117:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106121:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106126:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106131:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106136:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106142:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106147:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106152:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106157:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106162:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106167:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106172:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106178:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106183:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106187:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106199:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106203:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106208:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106213:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106218:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106223:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106228:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106233:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1785390179.106238:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1785390179.107856:0:12942:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1785390179.107861:0:12942:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1785390179.108644:0:12942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf540f14060 - data ffff8cf53f9ded80/ffff8cf53fe9a400 00000020:01000000:2.0:1785390179.108769:0:12942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf5060671e0 - data ffff8cf50fbe5d80/ffff8cf50de18000 00000020:00000080:2.0:1785390179.109286:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec946 00000020:00000080:2.0:1785390179.109294:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf503ea4800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1785390179.109312:0:12942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf509225000 from MGS, refs=2 00000020:01000004:2.0:1785390179.109316:0:12942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf509225000 2 00000020:01000004:2.0:1785390179.109319:0:12942:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf509225000 from MGS 00000020:00000080:2.0:1785390179.109338:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785390179.109344:0:12942:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1785390179.109347:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf503ea2800/MGS 00000020:00000080:2.0:1785390179.109349:0:12942:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf503ea2800/MGS for MGS 00000020:01000000:2.0:1785390179.109355:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1785390179.109416:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1785390179.109420:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785390179.109425:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785390179.109431:0:12942:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cf52fdf2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785390179.109438:0:12942:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8cf5058f0000) has exports, disconnecting them 00000020:00080000:2.0:1785390179.109442:0:12942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cf52fdf2000), last request at 1785389876 00000020:00000080:2.0:1785390179.109446:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5eca11 00000020:00080000:2.0:1785390179.109456:0:12942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf52fdf2000): rc 0 00000020:00000080:2.0:1785390179.109460:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf52fdf2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1785390179.110089:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf503ea4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1785390179.110097:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf52fdf2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1785390179.121596:0:12942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1785390179.121606:0:12942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785390179.121610:0:12942:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1785390179.121619:0:12942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1785390179.121650:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf52fdf2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1785390179.121788:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.121796:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1785390179.121801:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf52fdf4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1785390179.121804:0:12942:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf52fdf4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1785390179.121816:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1785390179.121880:0:12942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf509225000 1 00000020:00000080:1.0:1785390179.121886:0:12942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec938 00000020:00000080:1.0:1785390179.121892:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf503ea7000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1785390179.121900:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1785390179.121908:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf503ea7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1785390179.121917:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.121922:0:12942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785390179.121925:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8cf5058f4d40) has no exports 00000020:00000080:1.0:1785390179.262946:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.262961:0:12942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1785390179.262967:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf506253000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1785390179.262971:0:12942:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf506253000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1785390179.262978:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1785390179.263116:0:12942:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cf506256800 00000020:01000000:1.0:1785390179.263141:0:12942:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1785390179.263145:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390179.263149:0:12942:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785390179.263154:0:12942:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8cf50ddfcd40) has no exports 00000100:00100000:0.0:1785390179.265430:0:5802:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cf50de76800:5802] 0 exiting: rc = 1 00000100:00100000:0.0:1785390179.265545:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cf50dddf000:5804] 2 exiting: rc = 0 00000100:00100000:3.0:1785390179.266591:0:7121:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cf51dd1f200:7121] 3 exiting: rc = 0 00000100:00100000:2.0:1785390179.270964:0:5803:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cf50dddf600:5803] 1 exiting: rc = 0 00000100:00100000:0.0:1785390179.280765:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280786:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280792:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280797:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280803:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280808:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280814:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280819:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280824:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280829:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280835:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280839:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280844:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280849:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280855:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280860:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280865:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280870:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280876:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280880:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280886:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280890:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280895:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280900:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280906:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280916:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280921:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280926:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280932:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280937:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280942:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280948:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280953:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280969:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280975:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280980:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280985:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280991:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.280996:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281001:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281007:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281012:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281017:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281022:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281027:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281032:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281038:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281042:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281048:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281053:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281058:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281062:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281070:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281075:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281081:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281085:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281091:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281096:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281101:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281107:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281112:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281118:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281124:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.281129:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.291685:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cf50dddf200:5805] 0 exiting: rc = 1 00000100:00100000:3.0:1785390179.292160:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cf50de58000:5806] 1 exiting: rc = 0 00000100:00100000:0.0:1785390179.294662:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294672:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294682:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294706:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294712:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294718:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294724:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294729:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294735:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294741:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294747:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294752:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294759:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294764:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294770:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294775:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294780:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294785:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294791:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294795:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294800:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294805:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294810:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294815:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294820:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294826:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294831:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294836:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294840:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294845:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294850:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294857:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294861:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294867:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294872:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294877:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294881:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294886:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294899:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294904:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294909:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294914:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294919:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294924:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294928:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294933:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294937:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294942:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294946:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294951:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294955:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294960:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294964:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294968:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294972:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294976:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294981:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294985:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294990:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.294995:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.295001:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.295006:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.295010:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.295016:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.295756:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cf50de54400:5808] 1 exiting: rc = 0 00000100:00100000:2.0:1785390179.296645:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cf50de55800:5807] 0 exiting: rc = 1 00000100:00100000:0.0:1785390179.296718:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296736:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296760:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296768:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296774:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296780:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296785:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296790:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296804:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296810:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296815:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296821:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296826:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296832:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296852:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296861:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296866:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296872:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296878:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296884:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296890:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296897:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296902:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296908:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296914:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296920:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296940:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296947:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296953:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296959:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296966:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296971:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296978:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296983:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296989:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.296995:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297001:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297006:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297023:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297030:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297036:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297041:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297047:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297057:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297063:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297069:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297074:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297080:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297085:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297091:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297108:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297115:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297120:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297126:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297132:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297137:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297143:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297148:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297153:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297158:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297164:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297169:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297175:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.297181:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.312983:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cf50de55c00:5810] 1 exiting: rc = 0 00000100:00100000:1.0:1785390179.313677:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cf50de55400:5809] 0 exiting: rc = 1 00000100:00100000:0.0:1785390179.314341:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314348:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314354:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314359:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314364:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314369:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314373:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314378:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314383:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314399:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314404:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314408:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314414:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314434:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314439:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314444:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314449:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314454:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314460:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314465:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314470:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314475:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314480:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314486:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314491:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314495:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314501:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314505:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314510:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314515:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314869:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314879:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314884:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314889:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314895:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314900:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314905:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314909:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314914:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314919:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314925:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314929:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314934:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314940:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314945:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314950:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314955:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314961:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314976:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314981:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314986:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314991:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.314996:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315001:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315006:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315011:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315015:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315020:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315025:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315031:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315036:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315041:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315046:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.315052:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390179.325676:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cf50de54600:5812] 1 exiting: rc = 0 00000100:00100000:1.0:1785390179.328063:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cf50de30800:5811] 0 exiting: rc = 1 00000100:00100000:1.0:1785390179.328151:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328158:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328163:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328168:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328173:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328178:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328183:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328187:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328191:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328196:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328200:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328204:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328209:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328226:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328231:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328645:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328653:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328658:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328664:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328668:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328673:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328678:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328683:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328688:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328692:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328697:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328701:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328706:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328711:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328715:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328720:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328724:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328728:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328733:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328738:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328742:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328747:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328751:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328757:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328761:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328765:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328770:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328829:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328836:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328840:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328845:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328850:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328854:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328865:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328870:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328875:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328880:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328885:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328890:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328895:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328900:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328905:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328910:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328915:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328920:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328926:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328931:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328936:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.328994:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329576:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cf50de54e00:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1785390179.329735:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cf50de55e00:5814] 1 exiting: rc = 0 00000100:00100000:1.0:1785390179.329853:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329860:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329865:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329870:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329876:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329882:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329886:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329892:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329897:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329902:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329907:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329912:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329917:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329922:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329927:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329933:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.329939:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330157:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330172:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330176:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330181:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330185:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330189:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330194:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330198:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330202:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330208:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330212:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330222:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330227:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330232:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330651:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330657:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330662:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330667:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330671:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330676:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330681:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330686:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330691:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330697:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330701:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330706:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330710:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330715:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330720:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330724:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330728:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330732:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330737:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330741:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330745:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330750:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330761:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330765:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330770:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330874:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330880:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330886:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330891:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330897:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330902:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330908:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1785390179.330913:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.332437:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cf50ddd6400:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1785390179.332847:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cf50de58600:5815] 0 exiting: rc = 1 00000100:00100000:0.0:1785390179.333163:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cf50de59200:5817] 2 exiting: rc = 0 00000100:00100000:0.0:1785390179.333217:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333232:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333453:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333466:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333474:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333494:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333519:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333543:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333550:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333555:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333562:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333567:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333573:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333833:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333841:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333847:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333861:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333866:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333872:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333877:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333883:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333889:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333896:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333902:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333908:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333915:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333920:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333927:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333933:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.333939:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334336:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334344:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334351:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334357:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334363:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334368:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334374:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334380:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334394:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334400:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334404:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334409:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334415:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334421:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334427:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334433:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334439:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334444:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334449:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334454:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334459:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334471:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334477:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334483:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334501:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334507:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334513:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334519:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334547:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334554:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334560:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334566:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334571:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390179.334994:0:12942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1785390179.344549:0:12942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1785390179.344562:0:12942:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1785390179.344567:0:12942:0:(genops.c:906:class_export_put()) final put ffff8cf50dea7800/MDS_uuid 00000020:00000080:1.0:1785390179.344572:0:12942:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf50dea7800/MDS_uuid for MDS 00000020:01000000:1.0:1785390179.344875:0:12942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1785390179.345380:0:12942:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1785390179.798262:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390180.822824:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390181.849808:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390182.423649:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879297536:0@lo:400:kworker.0 00000400:00000100:1.0:1785390182.423713:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872116879297536 offset 0 length 224: 4 00000100:00100000:1.0:1785390182.423766:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390182.423771:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879297408:0@lo:400:kworker.0 00000400:00000100:1.0:1785390182.424665:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872116879297408 offset 0 length 224: 4 00000100:00100000:1.0:1785390182.424709:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879297664:0@lo:400:kworker.0 00000400:00000100:1.0:1785390182.424731:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872116879297664 offset 0 length 224: 4 00000001:00100000:2.0:1785390182.466056:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1785390182.466065:0:7506:0:(genops.c:906:class_export_put()) final put ffff8cf51f0e5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1785390182.466136:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf51f0e5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1785390182.466237:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf51f0e3000 for lustre-OST0001 00000020:01000004:0.0:1785390182.812497:0:13095:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1785390182.840479:0:13095:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1785390182.840950:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390182.840967:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390182.840987:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390182.840995:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390182.841009:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1785390182.841014:0:13095:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1785390182.841034:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785390182.841045:0:13095:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fee6300 x1872116879297536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390182.841066:0:13095:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1785390182.841072:0:13095:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1785390182.841094:0:13095:0:(import.c:65:import_set_state_nolock()) ffff8cf53f42c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1785390182.841150:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390182.841157:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390182.841164:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5400 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785390182.841167:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390182.841175:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785390182.841181:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390182.841186:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785390182.841188:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1785390182.841191:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1785390182.841229:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390182.841234:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1785390182.841258:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390182.841265:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5ecc87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x33dffe75ff5ecc8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390182.841282:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390182.841284:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390182.841286:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390182.841299:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872116879297792:0@lo:39:umount.0 00000400:00000100:2.0:1785390182.841343:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872116879297792 offset 0 length 224: 4 00000100:00100000:2.0:1785390182.841416:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785390182.841425:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879297920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785390182.841430:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879297536:0@lo:400:kworker.0 00000100:00100000:2.0:1785390182.841456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390182.841566:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879297920 00000100:00100000:0.0:1785390182.841573:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879297920 00000100:00100000:0.0:1785390182.841620:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1785390182.841627:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1872116879297920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1785390182.841634:0:5790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785390182 with bad export cookie 3737985998489831771 00000100:00100000:0.0:1785390182.856823:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1872116879297920:12345-0@lo:103:ldlm_bl.0 Request processed in 15186us (15358us total) trans 0 rc -107/-107 00000100:00100000:0.0:1785390182.856837:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1785390182.856872:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1785390182.856877:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8cf5113e1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1785390182.856881:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1785390182.865630:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1785390182.865636:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1785390182.865644:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fee6680 x1872116879297408/t0(0) o400->MGC192.168.202.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1785390198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390182.865661:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fc85c00 x1872116879297920/t0(0) o103->MGC192.168.202.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1785390198 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1785390182.865671:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1785390182.865673:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1785390182.865675:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1785390182.865678:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8cf5113e1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785390182.865682:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 183 00000100:00080000:2.0:1785390182.865690:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff8cf5113e1000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1785390182.865721:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fc85f80 x1872116879298048/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785390182.865807:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ebcf8f-53c9-4fee-a69e-b0198873419f:3306:1872116879298048:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1785390182.865854:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872116879298048 offset 0 length 520: 4 00000100:00100000:2.0:1785390182.865919:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:19ebcf8f-53c9-4fee-a69e-b0198873419f:3309:1872116879297920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785390182.866405:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:19ebcf8f-53c9-4fee-a69e-b0198873419f:3308:1872116879297408:0@lo:400:kworker.0 00010000:00010000:3.0:1785390182.870477:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390183.893701:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390184.917675:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390185.941795:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390186.966266:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785390187.541712:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1785390187.541722:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1785390187.544162:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879298176:0@lo:400:kworker.0 00000400:00000100:3.0:1785390187.544216:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872116879298176 offset 0 length 224: 4 00010000:00010000:2.0:1785390187.989826:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390189.013886:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390190.037664:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390191.062134:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390192.087558:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390192.149722:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390182/real 1785390182] req@ffff8cf53fc85f80 x1872116879298048/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1785390192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390192.149756:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf53fc85f80 x1872116879298048/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1785390192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390192.149767:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390182/real 1785390182] req@ffff8cf53fee7480 x1872116879297792/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785390192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390192.149778:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf53fee7480 x1872116879297792/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785390192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785390192.149795:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf5113e1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785390192.149815:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1785390192.149819:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ebcf8f-53c9-4fee-a69e-b0198873419f:3306:1872116879298048:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1785390192.149824:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf53f42c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1785390192.149839:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872116879297792:0@lo:39:umount.0 00000100:00080000:1.0:1785390192.149913:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1785390192.149918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1785390192.149921:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf5113e1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785390192.149926:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 491 00000100:00080000:1.0:1785390192.149931:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.154@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1785390192.149937:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff8cf5113e1000 using connection 192.168.202.154@tcp/0@lo 00000100:00080000:0.0:1785390192.149946:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1785390192.149949:0:13095:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1785390192.149953:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1785390192.149967:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fee4a80 x1872116879298304/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785390192.150054:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1785390192.150064:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879298432:0@lo:400:kworker.0 00000400:00000100:1.0:1785390192.150105:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872116879298432 offset 0 length 224: 4 00000100:00100000:2.0:1785390192.150283:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ebcf8f-53c9-4fee-a69e-b0198873419f:3306:1872116879298304:0@lo:250:kworker.0 00000400:00000100:2.0:1785390192.150302:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1872116879298304 offset 0 length 520: 4 00010000:00010000:0.0:1785390192.150867:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150891:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150899:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150905:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150930:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390192.150937:0:13095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150943:0:13095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150949:0:13095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150956:0:13095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390192.150976:0:13095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1785390192.150980:0:13095:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1785390192.150998:0:13095:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1785390192.151002:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1785390192.151006:0:13095:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785390192.151011:0:13095:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785390192.151014:0:13095:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8cf53a898000) has no exports 00000020:00080000:0.0:1785390192.151041:0:13095:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8cf53a898000) has no exports 00010000:00010000:1.0:1785390192.151287:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785390192.151294:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151301:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390192.151305:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151314:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390192.151321:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390192.151327:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1785390192.151330:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1785390192.151331:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1785390192.151342:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:1.0:1785390192.151345:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151352:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5ecc95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecc9c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151364:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390192.151367:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151378:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4e00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390192.151381:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151388:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390192.151395:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390192.151400:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1785390192.151402:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1785390192.151404:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1785390192.151408:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:1.0:1785390192.151411:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151417:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5ecebe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecec5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390192.151425:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390192.151426:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390192.151428:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1785390192.152673:0:13095:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf519ab8180 - data ffff8cf53f94f5e8/ffff8cf503128c00 00000020:01000000:0.0:1785390192.152786:0:13095:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf519ab8840 - data ffff8cf50fb74288/ffff8cf50e021c00 00010000:00010000:2.0:1785390192.153107:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1785390192.165739:0:13095:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1785390192.247947:0:13095:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5eca96 00000020:00000080:2.0:1785390192.247957:0:13095:0:(genops.c:906:class_export_put()) final put ffff8cf53a346800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1785390192.247997:0:13095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf5111bb800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1785390192.248001:0:13095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf5111bb800 2 00000020:01000004:2.0:1785390192.248004:0:13095:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf5111bb800 from lustre-OST0000 00000020:00000080:2.0:1785390192.248027:0:13095:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785390192.248036:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1785390192.248040:0:13095:0:(genops.c:906:class_export_put()) final put ffff8cf535fe2800/lustre-OST0000_UUID 00000020:00000080:2.0:1785390192.248043:0:13095:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1785390192.248049:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1785390192.248153:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53a346800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1785390192.248297:0:13095:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1785390192.248301:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1785390192.248305:0:13095:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785390192.248310:0:13095:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785390192.248316:0:13095:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cf53f42d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785390192.248323:0:13095:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8cf53f423380) has exports, disconnecting them 00000020:00080000:2.0:1785390192.248327:0:13095:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cf53f42d800), last request at 1785389898 00000020:00000080:2.0:1785390192.248331:0:13095:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecac0 00000020:00080000:2.0:1785390192.248341:0:13095:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf53f42d800): rc 0 00000020:00000080:2.0:1785390192.248346:0:13095:0:(genops.c:906:class_export_put()) final put ffff8cf53f42d800/lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1785390192.249391:0:13095:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1785390192.249396:0:13095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1785390192.249399:0:13095:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1785390192.249404:0:13095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1785390192.256563:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53f42d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1785390192.258078:0:13095:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785390192.258089:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1785390192.258095:0:13095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf5111bb800 1 00000020:00000080:3.0:1785390192.258102:0:13095:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5eca50 00000020:00000080:3.0:1785390192.258110:0:13095:0:(genops.c:906:class_export_put()) final put ffff8cf5111b8000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1785390192.258116:0:13095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1785390192.258121:0:13095:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785390192.258124:0:13095:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1785390192.258128:0:13095:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8cf5058f19c0) has no exports 00000020:00000080:1.0:1785390192.258753:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf53f42c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1785390192.258759:0:8:0:(genops.c:906:class_export_put()) final put ffff8cf535fe6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1785390192.258762:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535fe6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1785390192.258777:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1785390192.258828:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5111b8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1785390192.308791:0:13095:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785390192.308804:0:13095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1785390192.308809:0:13095:0:(genops.c:906:class_export_put()) final put ffff8cf5111b9800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1785390192.308827:0:13095:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5111b9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1785390192.308836:0:13095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1785390192.308996:0:13095:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cf5111bf800 00000020:02000400:3.0:1785390192.309052:0:13095:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1785390193.110599:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390194.137046:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390195.157626:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390196.191896:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1785390196.394151:0:13247:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1785390196.418651:0:13247:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1785390196.418730:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390196.418745:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390196.418753:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390196.418760:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390196.418789:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1785390196.418795:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1785390196.418818:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785390196.418829:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fee4000 x1872116879297664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390196.418849:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fee6680 x1872116879298176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390196.418862:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fee5880 x1872116879298432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390208 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390196.418870:0:13247:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1785390196.418875:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1785390196.418910:0:13247:0:(import.c:65:import_set_state_nolock()) ffff8cf53b947800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1785390196.419007:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390196.419014:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390196.419021:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4200 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:2.0:1785390196.419024:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390196.419033:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785390196.419050:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390196.419055:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785390196.419058:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1785390196.419060:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1785390196.419072:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:2.0:1785390196.419075:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390196.419082:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5ecc6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecc72 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390196.419093:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390196.419095:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390196.419097:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390196.419114:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872116879298560:0@lo:39:umount.0 00000400:00000100:2.0:1785390196.419168:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1872116879298560 offset 0 length 224: 4 00000100:00100000:3.0:1785390196.419304:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879297664:0@lo:400:kworker.0 00000100:00100000:0.0:1785390196.419451:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879298432:0@lo:400:kworker.0 00000100:00100000:0.0:1785390196.419460:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879298176:0@lo:400:kworker.0 00010000:00010000:2.0:1785390197.205663:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1785390197.269744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1785390197.269754:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1785390198.229958:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390199.253664:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390200.277688:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390201.302689:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390202.325852:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1785390202.391580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1785390202.391593:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1785390203.352854:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390204.385317:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390205.397682:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390206.421670:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390206.677656:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390196/real 1785390196] req@ffff8cf53fee5c00 x1872116879298560/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785390206 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390206.677689:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf53fee5c00 x1872116879298560/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785390206 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785390206.677730:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf53b947800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1785390206.677755:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872116879298560:0@lo:39:umount.0 00000100:00080000:1.0:1785390206.678448:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1785390206.678462:0:13247:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1785390206.678468:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1785390206.679366:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679504:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679512:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679520:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679566:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390206.679573:0:13247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679579:0:13247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679584:0:13247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679589:0:13247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390206.679613:0:13247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1785390206.679618:0:13247:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1785390206.679636:0:13247:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1785390206.679639:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1785390206.679643:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1785390206.679648:0:13247:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1785390206.679651:0:13247:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8cf53fea4d40) has no exports 00000020:00080000:1.0:1785390206.679670:0:13247:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8cf53fea4d40) has no exports 00010000:00010000:3.0:1785390206.680521:0:12943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785390206.680568:0:12943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680578:0:12943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5013fd000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390206.680589:0:12943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680599:0:12943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390206.680606:0:12943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390206.680612:0:12943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1785390206.680623:0:12943:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1785390206.680625:0:12943:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1785390206.680651:0:12943:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:3.0:1785390206.680663:0:12943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680671:0:12943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5013fd000/0x33dffe75ff5ecc79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5ecc80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680685:0:12943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390206.680689:0:12943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680695:0:12943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716000 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390206.680698:0:12943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680706:0:12943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390206.680712:0:12943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390206.680718:0:12943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1785390206.680721:0:12943:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1785390206.680722:0:12943:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1785390206.680727:0:12943:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:3.0:1785390206.680729:0:12943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680735:0:12943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf503716000/0x33dffe75ff5eceb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5eceb7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390206.680747:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390206.680754:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390206.680756:0:12943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390206.680851:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1785390206.683114:0:13247:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf50dc182a0 - data ffff8cf534a3b288/ffff8cf51f06ec00 00000020:01000000:1.0:1785390206.685353:0:13247:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8cf51826d480 - data ffff8cf50e45a798/ffff8cf535ecd400 00100000:10000000:1.0:1785390206.694806:0:13247:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1785390206.762038:0:13247:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb61 00000020:00000080:2.0:1785390206.762048:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf5356ce000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1785390206.762066:0:13247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf53b946000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1785390206.762069:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf53b946000 2 00000020:01000004:2.0:1785390206.762072:0:13247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf53b946000 from lustre-OST0001 00000020:00000080:2.0:1785390206.762095:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785390206.762105:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1785390206.762107:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf5356ce800/lustre-OST0001_UUID 00000020:00000080:2.0:1785390206.762110:0:13247:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5356ce800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1785390206.762117:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1785390206.762227:0:13247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 19ebcf8f-53c9-4fee-a69e-b0198873419f->MGS 00000020:00000080:3.0:1785390206.762241:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5356ce000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:2.0:1785390206.762243:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785390206.762261:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390206.762268:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1785390206.762273:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1785390206.762276:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1785390206.762290:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:2.0:1785390206.762294:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf500031a00/0x33dffe75ff5eca73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5eca7a expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390206.762310:0:13247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1785390206.762333:0:13247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390206.762338:0:13247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1785390206.762341:0:13247:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1785390206.762342:0:13247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1785390206.762352:0:13247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf5113e1000 00010000:00010000:2.0:1785390206.762355:0:13247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5400/0x33dffe75ff5eccbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33dffe75ff5eccc6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1785390206.762447:0:13247:0:(import.c:65:import_set_state_nolock()) ffff8cf5113e1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1785390206.762461:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1785390206.762464:0:13247:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1785390206.762466:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1785390206.762469:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1785390206.762481:0:13247:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf53fee4a80 x1872116879298304/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1785390207 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1785390206.762502:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1785390206.762505:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:3.0:1785390206.762763:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:19ebcf8f-53c9-4fee-a69e-b0198873419f:3306:1872116879298304:0@lo:250:kworker.0 10000000:01000000:2.0:1785390206.763069:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1785390206.763082:0:13247:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ec954 00000020:00000080:2.0:1785390206.763090:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf5113e5000/19ebcf8f-53c9-4fee-a69e-b0198873419f 00000020:01000000:2.0:1785390206.763107:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.154@tcp (flags='') 00000020:00000080:2.0:1785390206.763115:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785390206.763122:0:13247:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1785390206.763128:0:13247:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8cf50ddfb380) has no exports 00000020:00000080:3.0:1785390206.763232:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5113e5000/19ebcf8f-53c9-4fee-a69e-b0198873419f for MGC192.168.202.154@tcp 10000000:01000000:0.0:1785390206.763314:0:5800:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1785390206.763693:0:13247:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.154@tcp: client import never connected 00000100:00080000:2.0:1785390206.763697:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1785390206.763711:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1785390206.763714:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1785390206.763729:0:13247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1785390206.763778:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1785390206.763785:0:13247:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.154@tcp (uuid 19ebcf8f-53c9-4fee-a69e-b0198873419f) 00000020:01000000:2.0:1785390206.763792:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1785390206.763795:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1785390206.763799:0:13247:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1785390206.763805:0:13247:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cf50e181000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1785390206.763822:0:13247:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8cf50e2c3380) has exports, disconnecting them 00000020:00080000:2.0:1785390206.763826:0:13247:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cf50e181000), last request at 1785389923 00000020:00000080:2.0:1785390206.763831:0:13247:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb8b 00000020:00080000:2.0:1785390206.763843:0:13247:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf50e181000): rc 0 00000020:00000080:2.0:1785390206.763847:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf50e181000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1785390206.764792:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf5113e1000 for MGC192.168.202.154@tcp 00000020:00000080:3.0:1785390206.764803:0:8:0:(genops.c:906:class_export_put()) final put ffff8cf5113e3000/19ebcf8f-53c9-4fee-a69e-b0198873419f 00000020:00000080:3.0:1785390206.764806:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5113e3000/19ebcf8f-53c9-4fee-a69e-b0198873419f for MGC192.168.202.154@tcp 00000020:01000000:3.0:1785390206.764815:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.154@tcp (19ebcf8f-53c9-4fee-a69e-b0198873419f) 00000020:00000080:3.0:1785390206.766812:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf50e181000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1785390206.790574:0:13247:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1785390206.790583:0:13247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1785390206.790587:0:13247:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1785390206.790594:0:13247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1785390206.790625:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf53b947800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1785390206.791570:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1785390206.791690:0:12943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1785390206.795946:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1785390206.797561:0:5786:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cf510b29200:5786] 0 exiting: rc = 1 00000100:00100000:3.0:1785390206.797715:0:11537:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cf53a7f6800:11537] 2 exiting: rc = 0 00000100:00100000:3.0:1785390206.797778:0:5787:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cf503eb3c00:5787] 1 exiting: rc = 0 00000100:00100000:0.0:1785390206.797953:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.798188:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cf503eb3000:5790] 2 exiting: rc = 0 00000100:00100000:3.0:1785390206.798472:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cf518231e00:5789] 1 exiting: rc = 0 00000100:00100000:2.0:1785390206.798593:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cf518230e00:5788] 0 exiting: rc = 1 00000100:00100000:0.0:1785390206.800661:0:11040:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cf53fc35c00:11040] 3 exiting: rc = 0 00000100:00100000:3.0:1785390206.800765:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800772:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800781:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800786:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800791:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800795:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800801:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800806:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800824:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800834:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800840:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800845:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800850:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800864:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800871:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800878:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800884:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800889:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800894:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800899:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800904:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800910:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800915:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800920:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800925:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800930:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800935:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800941:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800946:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800952:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800957:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800962:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800967:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800982:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800987:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800993:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.800999:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801004:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801008:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801013:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801026:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801031:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801036:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801041:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801051:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801056:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801061:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801067:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801072:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801077:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801082:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801087:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801092:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801097:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801102:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801107:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801112:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801117:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801122:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.801127:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1785390206.802058:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1785390206.802066:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1785390206.802072:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf51f0e5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1785390206.802076:0:13247:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf51f0e5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1785390206.802081:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1785390206.802119:0:13247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf53b946000 1 00000020:00000080:3.0:1785390206.802126:0:13247:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ecb30 00000020:00000080:3.0:1785390206.802132:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf535a56800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1785390206.802157:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1785390206.802163:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1785390206.802168:0:13247:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1785390206.802172:0:13247:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8cf50e2c19c0) has no exports 00000020:00000080:0.0:1785390206.802230:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535a56800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1785390206.830504:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785390206.830517:0:13247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1785390206.830540:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf53b943800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1785390206.830545:0:13247:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf53b943800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1785390206.830554:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1785390206.830759:0:13247:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cf53b941000 00000020:01000000:0.0:1785390206.830780:0:13247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1785390206.830784:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1785390206.830787:0:13247:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1785390206.830791:0:13247:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8cf5058f3380) has no exports 00000020:00000080:0.0:1785390206.830809:0:13247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1785390206.830815:0:13247:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1785390206.830817:0:13247:0:(genops.c:906:class_export_put()) final put ffff8cf5111ba000/OSS_uuid 00000020:00000080:0.0:1785390206.830819:0:13247:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf5111ba000/OSS_uuid for OSS 00000020:01000000:0.0:1785390206.830822:0:13247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1785390206.830844:0:5799:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1785390206.832044:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cf541cfb200:6599] 2 exiting: rc = 0 00000100:00100000:0.0:1785390206.836802:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cf50e0ba600:6597] 0 exiting: rc = 1 00000100:00100000:1.0:1785390206.837054:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cf506bd2200:6598] 1 exiting: rc = 0 00000100:00100000:3.0:1785390206.838967:0:7936:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cf51f098400:7936] 3 exiting: rc = 0 00000100:00100000:0.0:1785390206.839600:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839609:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839616:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839622:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839628:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839633:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839637:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839642:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839647:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839654:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839659:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839664:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839669:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839674:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839680:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839684:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839689:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839694:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839699:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839704:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839710:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839715:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839720:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839725:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839743:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839748:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839753:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839758:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839764:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839768:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839773:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839778:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839784:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839789:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839795:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839808:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839813:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839818:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839823:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839834:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839840:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839845:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839849:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839865:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839871:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839877:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839881:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839891:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839896:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839907:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839912:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839919:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839925:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839930:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839936:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839948:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839957:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839981:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839993:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.839998:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.840004:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.840046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.841851:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cf50371d400:6600] 0 exiting: rc = 1 00000100:00100000:1.0:1785390206.843785:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cf50e21e800:6601] 1 exiting: rc = 0 00000100:00100000:0.0:1785390206.847595:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847607:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847612:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847618:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847623:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847628:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847649:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847654:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847660:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847665:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847671:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847676:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847681:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847686:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847691:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847696:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847702:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847707:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847711:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847716:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847722:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847783:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847793:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847798:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847822:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847828:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847834:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847840:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847844:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847849:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847910:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847918:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847924:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847929:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847935:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847940:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847945:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847951:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847956:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847961:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847967:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847979:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847985:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847990:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847994:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.847999:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848004:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848009:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848013:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848018:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848023:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848027:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848031:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848036:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848041:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848051:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848056:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848061:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848066:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848071:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848076:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848081:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1785390206.848091:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.852691:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cf506bd2400:6603] 1 exiting: rc = 0 00000100:00100000:3.0:1785390206.854691:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cf506bd3800:6602] 0 exiting: rc = 1 00000100:00100000:1.0:1785390206.906684:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cf51826e600:6604] 2 exiting: rc = 0 00000100:00100000:3.0:1785390206.908908:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908918:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908923:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908929:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908934:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908940:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908945:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908951:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908957:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908963:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908969:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908974:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908979:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908985:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908990:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.908996:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909001:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909007:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909012:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909018:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909023:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909029:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909034:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909039:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909060:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909066:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909072:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909077:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909083:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909088:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909094:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909109:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909115:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909122:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909128:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909147:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909154:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909162:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909167:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909172:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909178:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909183:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909189:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909194:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909200:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909205:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909212:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909217:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909236:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909242:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909247:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909252:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909257:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909263:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909268:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909274:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909281:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909287:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909293:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909299:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909304:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909310:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909316:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.909321:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912562:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cf540ff3e00:6606] 1 exiting: rc = 0 00000100:00100000:3.0:1785390206.912665:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cf50371d800:6605] 0 exiting: rc = 1 00000100:00100000:3.0:1785390206.912722:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912728:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912734:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912739:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912744:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912749:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912754:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912759:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912764:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912770:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912774:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912779:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912785:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912790:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912794:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912800:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912808:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912814:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912819:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912824:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912830:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912835:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912840:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912845:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912851:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912856:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912862:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912867:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912872:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912877:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912882:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912887:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912892:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912897:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912902:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912914:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912919:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912925:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912930:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912935:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912940:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912946:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912951:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912956:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912961:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912966:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912972:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912977:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912982:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912988:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912993:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.912998:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913003:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913008:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913013:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913018:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913022:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913028:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913033:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913039:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913044:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913050:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913055:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913065:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913578:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cf50e0bb600:6607] 0 exiting: rc = 1 00000100:00100000:3.0:1785390206.913626:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cf540ff2c00:6608] 1 exiting: rc = 0 00000100:00100000:3.0:1785390206.913669:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913675:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913681:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913687:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913698:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913704:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913709:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913715:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913721:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913726:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913731:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913737:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913753:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913759:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913765:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913772:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913778:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913783:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913789:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913794:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913800:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913805:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913811:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913817:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913834:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913841:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913847:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913853:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913860:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913865:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913871:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913877:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913883:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913889:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913894:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913900:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913917:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913923:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913929:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913939:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913944:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913950:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913956:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913961:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913966:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913973:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913978:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.913983:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914000:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914007:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914012:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914018:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914024:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914029:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914034:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914041:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914046:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914051:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914057:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914063:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914069:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914079:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914096:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1785390206.914102:0:13247:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1785390206.918890:0:13247:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1785390237.349719:0:13865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1785390249.432822:0:14277:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1785390249.432826:0:14277:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1785390249.432949:0:14277:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cf5356ae000 00000020:01000004:0.0:1785390249.432992:0:14277:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1785390249.433000:0:14277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1785390249.433014:0:14277:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cf50e2c19c0) 00000020:00000080:0.0:1785390249.433029:0:14277:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1785390249.469639:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1785390249.474517:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1785390249.478147:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 471: rc = 0 00100000:10000000:0.0:1785390249.478251:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 471: rc = 0 00100000:10000000:0.0:1785390249.478351:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 471: rc = 0 00100000:10000000:0.0:1785390249.478447:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 471: rc = 0 00100000:10000000:0.0:1785390249.482877:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 471: rc = 0 00100000:10000000:0.0:1785390249.483112:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1785390249.483180:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 471: rc = 0 00100000:10000000:0.0:1785390249.483418:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 473: rc = 0 00100000:10000000:2.0:1785390249.490991:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 203: rc = 0 00100000:10000000:2.0:1785390249.491144:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 203: rc = 0 00100000:10000000:2.0:1785390249.491649:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1785390249.491892:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 339: rc = 0 00100000:10000000:2.0:1785390249.492133:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 339: rc = 0 00100000:10000000:2.0:1785390249.492370:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1785390249.503264:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1785390249.503577:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 339: rc = 0 00100000:10000000:3.0:1785390249.503849:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1785390249.504107:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 339: rc = 0 00100000:10000000:3.0:1785390249.504336:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1785390249.504574:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 339: rc = 0 00100000:10000000:3.0:1785390249.504803:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1785390249.505022:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 339: rc = 0 00100000:10000000:3.0:1785390249.505442:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 361: rc = 0 00100000:10000000:3.0:1785390249.505734:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 361: rc = 0 00100000:10000000:3.0:1785390249.506001:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 361: rc = 0 00100000:10000000:3.0:1785390249.506221:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 361: rc = 0 00100000:10000000:3.0:1785390249.506442:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 361: rc = 0 00100000:10000000:3.0:1785390249.512780:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 361: rc = 0 00100000:10000000:3.0:1785390249.513060:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 361: rc = 0 00100000:10000000:3.0:1785390249.513555:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 361: rc = 0 00100000:10000000:3.0:1785390249.513816:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 361: rc = 0 00100000:10000000:3.0:1785390249.514182:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 361: rc = 0 00100000:10000000:3.0:1785390249.514426:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 361: rc = 0 00100000:10000000:3.0:1785390249.516779:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 361: rc = 0 00100000:10000000:3.0:1785390249.519040:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 361: rc = 0 00100000:10000000:3.0:1785390249.519334:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 361: rc = 0 00100000:10000000:3.0:1785390249.524953:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 361: rc = 0 00100000:10000000:3.0:1785390249.525231:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 361: rc = 0 00100000:10000000:3.0:1785390249.525470:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 361: rc = 0 00100000:10000000:3.0:1785390249.525760:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 361: rc = 0 00100000:10000000:3.0:1785390249.525986:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 361: rc = 0 00100000:10000000:3.0:1785390249.526201:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 361: rc = 0 00100000:10000000:3.0:1785390249.526440:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 361: rc = 0 00100000:10000000:3.0:1785390249.526712:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 361: rc = 0 00100000:10000000:3.0:1785390249.526940:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 361: rc = 0 00100000:10000000:3.0:1785390249.527170:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 361: rc = 0 00100000:10000000:3.0:1785390249.527429:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 361: rc = 0 00100000:10000000:3.0:1785390249.527718:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 361: rc = 0 00100000:10000000:3.0:1785390249.533878:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 361: rc = 0 00100000:10000000:3.0:1785390249.537405:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 361: rc = 0 00100000:10000000:3.0:1785390249.537680:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 361: rc = 0 00100000:10000000:3.0:1785390249.537912:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 361: rc = 0 00100000:10000000:3.0:1785390249.541404:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 361: rc = 0 00100000:10000000:1.0:1785390249.555384:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 361: rc = 0 00100000:10000000:1.0:1785390249.555828:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 663: rc = 0 00100000:10000000:1.0:1785390249.561237:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1785390249.561425:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 660: rc = 0 00100000:10000000:1.0:1785390249.561682:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1785390249.561768:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 660: rc = 0 00100000:10000000:1.0:1785390249.564875:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1785390249.565107:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 660: rc = 0 00100000:10000000:1.0:1785390249.565510:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1785390249.569250:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:1.0:1785390249.569499:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1785390249.569603:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 566: rc = 0 00100000:10000000:1.0:1785390249.569808:0:14277:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1785390249.569874:0:14277:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 566: rc = 0 00000020:00000080:1.0:1785390249.572900:0:14277:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1785390249.572909:0:14277:0:(osd_handler.c:1572:osd_obd_connect()) connect #0 00000020:00000080:1.0:1785390249.572919:0:14277:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edc55 00000020:01000004:1.0:1785390249.572927:0:14277:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1785390249.572932:0:14277:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1785390249.572937:0:14277:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf5356ae000 from MGS 00000020:01000004:1.0:1785390249.572940:0:14277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1785390249.573013:0:14277:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cf50ddfcd40) 00000020:00000080:1.0:1785390249.573025:0:14277:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1785390249.573083:0:14277:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf5356ae000 from MGS, refs=2 00080000:01000000:1.0:1785390249.573088:0:14277:0:(osd_handler.c:1572:osd_obd_connect()) connect #1 00000020:00000080:1.0:1785390249.573093:0:14277:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edc63 00000100:00100000:1.0:1785390249.573187:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1785390249.573294:0:14277:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1785390249.573300:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1785390249.580510:0:14277:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1785390249.580558:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1785390249.581196:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785390249.581355:0:14277:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1785390249.581359:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1785390249.582005:0:14277:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1785390249.582012:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1785390249.582228:0:14277:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1785390249.582233:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1785390249.582857:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390249.582861:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390249.582862:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390249.589724:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390249.589730:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390249.589732:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390249.592080:0:14277:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1785390249.604050:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1785390249.619449:0:14277:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1785390249.619466:0:14277:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1785390249.619469:0:14277:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1785390249.633979:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1785390249.634220:0:14277:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1785390249.634352:0:14277:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1785390249.634852:0:14277:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1785390249.635131:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1785390249.635252:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1785390249.635257:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1785390249.638038:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1785390249.638051:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1785390249.638386:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1785390249.638393:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1785390249.640047:0:14291:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1785390249.643808:0:14277:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1785390249.643834:0:14277:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.154@tcp' 00000020:01000004:2.0:1785390249.643836:0:14277:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1785390249.643866:0:14277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.154@tcp (typ=mgc) 00000020:00000080:2.0:1785390249.643879:0:14277:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.154@tcp (ffff8cf53fea4d40) 00000020:00000080:2.0:1785390249.643896:0:14277:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1785390249.643986:0:14277:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf508ef6800@MGC192.168.202.154@tcp: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1785390249.644122:0:14277:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.154@tcp-0 is initialized 00000040:01000000:2.0:1785390249.644128:0:14277:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 1 is initialized 10000000:01000000:2.0:1785390249.654723:0:14292:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1785390249.654815:0:14277:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.154@tcp (uuid 374ce4d4-733e-4fe2-9421-711e41cbfd01) 00000020:00000080:1.0:1785390249.654836:0:14277:0:(genops.c:1406:class_connect()) connect: client 374ce4d4-733e-4fe2-9421-711e41cbfd01, cookie 0x33dffe75ff5edc71 00000100:00080000:1.0:1785390249.654847:0:14277:0:(import.c:510:import_select_connection()) MGC192.168.202.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1785390249.654853:0:14277:0:(import.c:624:import_select_connection()) MGC192.168.202.154@tcp: import ffff8cf508ef6800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1785390249.654885:0:14277:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fee5f80 x1872116879298688/t0(0) o250->MGC192.168.202.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1785390249.654914:0:14277:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 374ce4d4-733e-4fe2-9421-711e41cbfd01->MGS 00000020:01000004:1.0:1785390249.654933:0:14277:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1785390249.654962:0:14277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1785390249.654988:0:14277:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cf50ddf99c0) 00000020:00000080:1.0:1785390249.654999:0:14277:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1785390249.657936:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:374ce4d4-733e-4fe2-9421-711e41cbfd01:3306:1872116879298688:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1785390249.658041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390249.659105:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879298688 00000100:00100000:2.0:1785390249.659116:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879298688 00000100:00100000:2.0:1785390249.659162:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390249.659171:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1872116879298688:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1785390249.659204:0:14288:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 374ce4d4-733e-4fe2-9421-711e41cbfd01@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:2.0:1785390249.659234:0:14288:0:(genops.c:1406:class_connect()) connect: client 374ce4d4-733e-4fe2-9421-711e41cbfd01, cookie 0x33dffe75ff5edc7f 00000100:00080000:2.0:1785390249.659374:0:14288:0:(import.c:65:import_set_state_nolock()) ffff8cf508ef0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785390249.659449:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+5:3306:x1872116879298688:12345-0@lo:250:mount.lustre.0 Request processed in 277us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390249.659456:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390249.659740:0:3306:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1785390249.659749:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.154@tcp: connect to target with instance 0 00000100:00080000:3.0:1785390249.659767:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1785390249.659772:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1785390249.659775:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf508ef6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1785390249.659777:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1785390249.659787:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1785390249.659792:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:374ce4d4-733e-4fe2-9421-711e41cbfd01:3306:1872116879298688:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1785390249.671125:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785390249.671302:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1785390249.671308:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1785390249.684471:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1785390249.684486:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1785390249.702660:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1785390249.702673:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1785390249.721397:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785390249.722735:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1785390249.722744:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1785390249.730622:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1785390249.730636:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1785390249.846105:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785390249.846287:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1785390249.846294:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1785390249.854862:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1785390249.854875:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1785390249.858003:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785390249.858173:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1785390249.858179:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1785390249.869154:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1785390249.869241:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1785390249.881591:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785390249.881770:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1785390249.881777:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1785390249.884645:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1785390249.884659:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1785390249.885233:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785390249.885380:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1785390249.885385:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1785390249.888643:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1785390249.888657:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1785390249.933818:0:14277:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785390249.934001:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1785390249.934007:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1785390249.952176:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1785390249.952190:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1785390249.955504:0:14277:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785390249.955516:0:14277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1785390249.956404:0:14277:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1785390249.956427:0:14277:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1785390249.956434:0:14277:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1785390249.956582:0:14277:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1785390249.956615:0:14277:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1785390249.956619:0:14277:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1785390249.956625:0:14277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785390249.956626:0:14277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390249.956627:0:14277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390249.956628:0:14277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390249.956629:0:14277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390249.956631:0:14277:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785390249.956632:0:14277:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785390249.956634:0:14277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390249.956635:0:14277:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785390249.956638:0:14277:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1785390249.956640:0:14277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785390249.956641:0:14277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785390249.956642:0:14277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390249.956643:0:14277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390249.956644:0:14277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390249.956645:0:14277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390249.956646:0:14277:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785390249.956647:0:14277:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785390249.956647:0:14277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390249.956648:0:14277:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1785390249.956675:0:14277:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1785390249.956693:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879298816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785390249.956773:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390249.956865:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1785390249.956944:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879298816 00000100:00100000:0.0:1785390249.956952:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879298816 00000100:00100000:0.0:1785390249.956993:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390249.957002:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+5:14277:x1872116879298816:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785390249.957055:0:14290:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1785390249.957058:0:14290:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1785390249.957062:0:14290:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1785390249.967730:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1785390249.968169:0:14290:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1785390249.979803:0:14312:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1785390249.979810:0:14312:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1785390249.979813:0:14312:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1785390249.979844:0:14312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1785390249.980159:0:14290:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1785390249.980169:0:14290:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1785390250.011635:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+5:14277:x1872116879298816:12345-0@lo:253:mount.lustre.0 Request processed in 54625us (54852us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390250.011669:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390250.011775:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879298816:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785390250.011790:0:14277:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1785390250.011794:0:14277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785390250.011795:0:14277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1785390250.011796:0:14277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390250.011798:0:14277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390250.011799:0:14277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390250.011800:0:14277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390250.011802:0:14277:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1785390250.011803:0:14277:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1785390250.011805:0:14277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390250.011806:0:14277:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785390250.011827:0:14277:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf5356ae000 from lustre-MDT0000 10000000:01000000:1.0:1785390250.011864:0:14277:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1785390250.011866:0:14277:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785390250.011871:0:14277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cf53fea4d40 10000000:01000000:1.0:1785390250.011877:0:14277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785390250.011884:0:14277:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf53fea4d40 from 1 10000000:01000000:1.0:1785390250.011887:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1785390250.011923:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.011935:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.011957:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.011974:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879298944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390250.012005:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.012087:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.012197:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879298944 00000100:00100000:2.0:1785390250.012204:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879298944 00000100:00100000:2.0:1785390250.012240:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785390250.012248:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+5:14277:x1872116879298944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785390250.012260:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390250.012273:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121d400/0x33dffe75ff5edc8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edc86 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390250.012294:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121d400/0x33dffe75ff5edc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edc86 expref: 6 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390250.012305:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121d400/0x33dffe75ff5edc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edc86 expref: 6 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390250.012314:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d400, rc 0) 00000100:00100000:2.0:1785390250.012348:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+6:14277:x1872116879298944:12345-0@lo:101:mount.lustre.0 Request processed in 100us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390250.012354:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1785390250.012437:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879298944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390250.012448:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.012457:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.012495:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390250.012515:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.012554:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.012626:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879299072 00000100:00100000:3.0:1785390250.012631:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879299072 00000100:00100000:3.0:1785390250.012661:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785390250.012667:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+6:14277:x1872116879299072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390250.012861:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+6:14277:x1872116879299072:12345-0@lo:501:mount.lustre.0 Request processed in 193us (344us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785390250.012867:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785390250.014041:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299072:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785390250.014071:0:14277:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1785390250.014090:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.014098:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390250.014106:0:14277:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf5356ae000 10000000:01000000:1.0:1785390250.014110:0:14277:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785390250.014114:0:14277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cf5356ae000 10000000:01000000:1.0:1785390250.014116:0:14277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1785390250.014118:0:14277:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8cf5356ae000 from 1 10000000:01000000:1.0:1785390250.014121:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1785390250.014138:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.014145:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.014154:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.014168:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390250.014196:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.014222:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.014335:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879299200 00000100:00100000:3.0:1785390250.014341:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879299200 00000100:00100000:3.0:1785390250.014370:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785390250.014376:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+6:14277:x1872116879299200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390250.014384:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390250.014395:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5edc9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edc94 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.014409:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5edc9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edc94 expref: 7 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.014418:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4800/0x33dffe75ff5edc9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edc94 expref: 7 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.014425:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4800, rc 0) 00000100:00100000:3.0:1785390250.014457:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+7:14277:x1872116879299200:12345-0@lo:101:mount.lustre.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.014463:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1785390250.015073:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390250.015085:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc9b expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.015104:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edc9b expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390250.015115:0:14277:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1785390250.015130:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc9b expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.015137:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5800/0x33dffe75ff5edc94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc9b expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390250.015144:0:14277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1785390250.015147:0:14277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785390250.015152:0:14277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cf5356ae000 10000000:01000000:1.0:1785390250.015154:0:14277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1785390250.015157:0:14277:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1785390250.015159:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1785390250.015171:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.015178:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.015184:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.015194:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390250.015218:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.015244:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390250.015343:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879299328 00000100:00100000:0.0:1785390250.015348:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879299328 00000100:00100000:0.0:1785390250.015383:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785390250.015391:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+7:14277:x1872116879299328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785390250.015408:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390250.015419:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503717e00/0x33dffe75ff5edca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edca2 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390250.015434:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503717e00/0x33dffe75ff5edca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edca2 expref: 8 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390250.015442:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503717e00/0x33dffe75ff5edca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edca2 expref: 8 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390250.015448:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717e00, rc 0) 00000100:00100000:0.0:1785390250.015485:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+8:14277:x1872116879299328:12345-0@lo:101:mount.lustre.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390250.015491:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785390250.015602:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390250.015612:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edca9 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.015619:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edca9 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.015656:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390250.015679:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.015739:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.023087:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879299456 00000100:00100000:2.0:1785390250.023103:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879299456 00000100:00100000:2.0:1785390250.023226:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785390250.023237:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+8:14277:x1872116879299456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390250.023678:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14277:x1872116879299456:12345-0@lo:501:mount.lustre.0 Request processed in 443us (7997us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390250.023687:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785390250.024072:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390250.024118:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390250.024160:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.024188:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.026129:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879299584 00000100:00100000:2.0:1785390250.026141:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879299584 00000100:00100000:2.0:1785390250.026187:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1785390250.026194:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14277:x1872116879299584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390250.026539:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14277:x1872116879299584:12345-0@lo:503:mount.lustre.0 Request processed in 329us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390250.026546:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1785390250.026719:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879299584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390250.030229:0:14313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14313:1872116879299712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785390250.030308:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390250.030356:0:14313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50608e300 going to sleep for 11 seconds 00000100:00100000:0.0:1785390250.031047:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879299712 00000100:00100000:0.0:1785390250.031055:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879299712 00000100:00100000:0.0:1785390250.031104:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785390250.031113:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14313:x1872116879299712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390250.031425:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14313:x1872116879299712:12345-0@lo:502:llog_process_th.0 Request processed in 313us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390250.031433:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785390250.031588:0:14313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14313:1872116879299712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1785390250.031616:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785390250.031627:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390250.031629:0:14313:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785390250.031635:0:14313:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1785390250.031638:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785390250.031652:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cf53fea0000) 00000020:00000080:2.0:1785390250.031670:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1785390250.031675:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1785390250.031734:0:14313:0:(osd_handler.c:1572:osd_obd_connect()) connect #2 00000020:00000080:2.0:1785390250.031740:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edcb7 00000020:00000080:2.0:1785390250.031928:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1785390250.031931:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785390250.031934:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390250.031998:0:14313:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1785390250.032003:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785390250.032007:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390250.032008:0:14313:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1785390250.032011:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1785390250.032068:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cf53fea19c0) 00000020:00000080:2.0:1785390250.032078:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1785390250.032082:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1785390250.032084:0:14313:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1785390250.032087:0:14313:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1785390250.032092:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1785390250.032129:0:14313:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf5356ae000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1785390250.032140:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cf53fea3380) 00000020:00000080:2.0:1785390250.032147:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1785390250.032188:0:14313:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1785390250.032192:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5edccc 00000020:00000080:2.0:1785390250.032288:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1785390250.032294:0:14313:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1785390250.032298:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x33dffe75ff5edcd3 00080000:01000000:2.0:1785390250.032303:0:14313:0:(osd_handler.c:1572:osd_obd_connect()) connect #3 00000020:00000080:2.0:1785390250.032306:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edcda 00010000:00010000:2.0:1785390250.256890:0:14313:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1785390250.257296:0:14313:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1785390250.257464:0:14313:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1785390250.266351:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cf53f420000) 00000020:00000080:3.0:1785390250.266371:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1785390250.266449:0:14313:0:(osd_handler.c:1572:osd_obd_connect()) connect #4 00000020:00000080:3.0:1785390250.266457:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edce8 00000020:00000080:1.0:1785390250.274973:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1785390250.297858:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x33dffe75ff5edcef 00000020:00000080:1.0:1785390250.300188:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1785390250.300199:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785390250.300207:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390250.300209:0:14313:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1785390250.300213:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1785390250.300215:0:14313:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1785390250.300217:0:14313:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1785390250.300219:0:14313:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1785390250.300220:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1785390250.300222:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390250.300223:0:14313:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1785390250.300225:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785390250.300230:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390250.300841:0:14313:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1785390250.300860:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1785390250.300901:0:14313:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1785390250.300918:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785390250.300920:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390250.300922:0:14313:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1785390250.300924:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785390250.300928:0:14313:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1785390250.300931:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390250.300933:0:14313:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1785390250.300935:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1785390250.300996:0:14313:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:1.0:1785390250.301065:0:14313:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1785390250.301069:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785390250.301105:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cf50ddfb380) 00000020:00000080:1.0:1785390250.301121:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1785390250.301125:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1785390250.301192:0:14313:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1785390250.301198:0:14313:0:(osd_handler.c:1572:osd_obd_connect()) connect #5 00000020:00000080:1.0:1785390250.301204:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edcfd 00010000:00080000:1.0:1785390250.302066:0:14313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf509226000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:1.0:1785390250.302394:0:14313:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1785390250.302800:0:14313:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1785390250.302848:0:14313:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1785390250.308439:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785390250.308496:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1785390250.308588:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1785390250.310264:0:14317:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1785390250.310270:0:14317:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1785390250.325819:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785390250.325835:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785390250.325875:0:14313:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1785390250.325897:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5edd04 00000100:00080000:0.0:1785390250.325909:0:14313:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785390250.325928:0:14313:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf509226000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1785390250.325979:0:14313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402d0e680 x1872116879299840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785390250.326002:0:14313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1785390250.326170:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879299840:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1785390250.326223:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872116879299840 offset 0 length 520: 4 00000020:01000000:0.0:1785390250.326644:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.326649:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.326651:0:14313:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1785390250.326654:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1785390250.326657:0:14313:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1785390250.326659:0:14313:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785390250.326660:0:14313:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785390250.326661:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1785390250.326664:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.326665:0:14313:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1785390250.326667:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785390250.326672:0:14313:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1785390250.326675:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.326676:0:14313:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1785390250.326679:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1785390250.326682:0:14313:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.154@tcp to nid 0x20000c0a8ca9a (192.168.202.154@tcp) 00000020:01000000:0.0:1785390250.326702:0:14313:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1785390250.326704:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785390250.326716:0:14313:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cf50e2c3380) 00000020:00000080:0.0:1785390250.326729:0:14313:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1785390250.326757:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1785390250.326811:0:14313:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1785390250.326816:0:14313:0:(osd_handler.c:1572:osd_obd_connect()) connect #6 00000020:00000080:0.0:1785390250.326820:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33dffe75ff5edd12 00010000:00080000:0.0:1785390250.326845:0:14313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf502f01000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:0.0:1785390250.327209:0:14313:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1785390250.328594:0:14313:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1785390250.328633:0:14313:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1785390250.329462:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785390250.329520:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1785390250.330736:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1785390250.332775:0:14319:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1785390250.332780:0:14319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1785390250.338065:0:14313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1785390250.338077:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1785390250.338109:0:14313:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1785390250.338128:0:14313:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5edd19 00000100:00080000:0.0:1785390250.338138:0:14313:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1785390250.338143:0:14313:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1785390250.338178:0:14313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402d0d180 x1872116879299968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1785390250.338208:0:14313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1785390250.338262:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.338266:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.338268:0:14313:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1785390250.338271:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390250.338274:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.338275:0:14313:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785390250.338278:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785390250.338280:0:14313:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785390250.338282:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.338284:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.338285:0:14313:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1785390250.338288:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390250.338290:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.338291:0:14313:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785390250.338294:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1785390250.338325:0:14313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14313:1872116879300096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390250.338400:0:14313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390250.338444:0:14313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf520279300 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.338708:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879299968:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1785390250.338736:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872116879299968 offset 0 length 520: 4 00000100:00100000:3.0:1785390250.338781:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300096 00000100:00100000:3.0:1785390250.338794:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300096 00000100:00100000:3.0:1785390250.338840:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785390250.338848:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14313:x1872116879300096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785390250.339087:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14313:x1872116879300096:12345-0@lo:502:llog_process_th.0 Request processed in 238us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.339094:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1785390250.339135:0:14313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14313:1872116879300096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390250.339158:0:14313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.339163:0:14313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.339164:0:14313:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785390250.339168:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1785390250.344334:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1785390250.344366:0:14277:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1785390250.344392:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edca9 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.344419:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef5a00/0x33dffe75ff5edca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edca9 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390250.344428:0:14277:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf5356ae000 from 1 10000000:01000000:1.0:1785390250.344430:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785390250.344468:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.344477:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.344487:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.344507:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390250.344585:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.344625:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50780 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.344783:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300224 00000100:00100000:3.0:1785390250.344790:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300224 00000100:00100000:3.0:1785390250.344822:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785390250.344829:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+9:14277:x1872116879300224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390250.344842:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390250.344855:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edd20 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.344873:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 10 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.344882:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 10 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.344889:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5a00, rc 0) 00000100:00100000:3.0:1785390250.344938:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+10:14277:x1872116879300224:12345-0@lo:101:mount.lustre.0 Request processed in 109us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.344945:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1785390250.347046:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390250.347066:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.347077:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.347810:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300352:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1785390250.347859:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.347893:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50780 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.348498:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300352 00000100:00100000:3.0:1785390250.348505:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300352 00000100:00100000:3.0:1785390250.348568:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785390250.348577:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+10:14277:x1872116879300352:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1785390250.348618:0:14290:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1785390250.348624:0:14290:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1785390250.348713:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+10:14277:x1872116879300352:12345-0@lo:256:mount.lustre.0 Request processed in 138us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.348720:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1785390250.349077:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300352:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1785390250.351223:0:14277:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785390250.351647:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.351662:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390250.351671:0:14277:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5356ae000 from 1 10000000:01000000:1.0:1785390250.351674:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1785390250.351715:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.351724:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.351735:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.351765:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390250.351818:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.351854:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50780 going to sleep for 11 seconds 00000100:00100000:0.0:1785390250.352318:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300480 00000100:00100000:0.0:1785390250.352326:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300480 00000100:00100000:0.0:1785390250.352377:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1785390250.352386:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+10:14277:x1872116879300480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785390250.352398:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390250.352411:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edd2e expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390250.352430:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390250.352440:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390250.352449:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716a00, rc 0) 00000100:00100000:0.0:1785390250.352490:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879300480:12345-0@lo:101:mount.lustre.0 Request processed in 105us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390250.352497:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785390250.354080:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390250.354103:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.354114:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.354194:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390250.354374:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.354412:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50780 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.354741:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300608 00000100:00100000:3.0:1785390250.354775:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300608 00000100:00100000:3.0:1785390250.354823:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785390250.354833:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879300608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390250.355204:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879300608:12345-0@lo:501:mount.lustre.0 Request processed in 373us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.355212:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1785390250.355602:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390250.355643:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390250.355685:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.355704:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50780 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.355827:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300736 00000100:00100000:3.0:1785390250.355832:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300736 00000100:00100000:3.0:1785390250.355865:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785390250.355870:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879300736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785390250.356007:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879300736:12345-0@lo:503:mount.lustre.0 Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.356014:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1785390250.356041:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879300736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785390250.358412:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14321:1872116879300864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390250.358469:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390250.358551:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf520279f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785390250.365660:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300864 00000100:00100000:1.0:1785390250.365676:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300864 00000100:00100000:1.0:1785390250.365740:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1785390250.365758:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14321:x1872116879300864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1785390250.366057:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14321:x1872116879300864:12345-0@lo:502:llog_process_th.0 Request processed in 310us (7587us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390250.366066:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1785390250.366260:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14321:1872116879300864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390250.366300:0:14321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390250.366313:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.366315:0:14321:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1785390250.366324:0:14321:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf5356ae000 00000020:00000080:0.0:1785390250.366326:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785390250.366333:0:14321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.366335:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.366336:0:14321:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1785390250.366339:0:14321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390250.366341:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.366342:0:14321:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1785390250.366345:0:14321:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf5356ae000 00000020:00000080:0.0:1785390250.366347:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1785390250.366400:0:14321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.366403:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.366404:0:14321:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1785390250.366406:0:14321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390250.366408:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.366410:0:14321:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1785390250.366413:0:14321:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf5356ae000 00000020:00000080:0.0:1785390250.366415:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1785390250.366457:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14321:1872116879300992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1785390250.366499:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390250.366547:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf520279f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.367333:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879300992 00000100:00100000:3.0:1785390250.367339:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879300992 00000100:00100000:3.0:1785390250.367378:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785390250.367385:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14321:x1872116879300992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785390250.367557:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14321:x1872116879300992:12345-0@lo:502:llog_process_th.0 Request processed in 172us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.367565:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785390250.367684:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14321:1872116879300992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1785390250.367711:0:14321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390250.367717:0:14321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390250.367718:0:14321:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1785390250.367723:0:14321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1785390250.371139:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1785390250.371169:0:14277:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1785390250.371189:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371202:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390250.371260:0:14277:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1785390250.371263:0:14277:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf5356ae000 10000000:01000000:3.0:1785390250.371266:0:14277:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf5356ae000 10000000:01000000:3.0:1785390250.371269:0:14277:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785390250.371275:0:14277:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf5356ae000 from 1 10000000:01000000:3.0:1785390250.371277:0:14277:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1785390250.371316:0:14277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371325:0:14277:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371336:0:14277:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390250.371357:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785390250.371409:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390250.371442:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.371464:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301120 00000100:00100000:3.0:1785390250.371469:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301120 00000100:00100000:3.0:1785390250.371506:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785390250.371513:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879301120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390250.371553:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390250.371565:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5edd43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edd3c expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371587:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5edd43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edd3c expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371597:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5800/0x33dffe75ff5edd43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd3c expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371606:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5800, rc 0) 00000100:00100000:3.0:1785390250.371642:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14277:x1872116879301120:12345-0@lo:101:mount.lustre.0 Request processed in 129us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.371649:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1785390250.371696:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390250.371709:0:14277:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd43 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.371719:0:14277:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edd43 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390250.371767:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390250.371788:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390250.371801:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.371910:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301248 00000100:00100000:2.0:1785390250.371914:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301248 00000100:00100000:2.0:1785390250.371955:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785390250.371961:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14277:x1872116879301248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390250.372185:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14277:x1872116879301248:12345-0@lo:501:mount.lustre.0 Request processed in 223us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390250.372192:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1785390250.378103:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390250.378167:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785390250.378245:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390250.378290:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.380100:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301376 00000100:00100000:2.0:1785390250.380111:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301376 00000100:00100000:2.0:1785390250.380157:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785390250.380165:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14277:x1872116879301376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390250.380506:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14277:x1872116879301376:12345-0@lo:503:mount.lustre.0 Request processed in 341us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390250.380515:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785390250.380727:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390250.387146:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14325:1872116879301504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785390250.387220:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390250.387919:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301504 00000100:00100000:2.0:1785390250.387927:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301504 00000100:00100000:2.0:1785390250.388096:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785390250.388105:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14325:x1872116879301504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785390250.388656:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14325:x1872116879301504:12345-0@lo:502:llog_process_th.0 Request processed in 551us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390250.388664:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785390250.388719:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50608e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390250.388742:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14325:1872116879301504:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1785390250.388805:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1785390250.388826:0:14325:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cf536a30000) 00000020:00000080:2.0:1785390250.388843:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1785390250.392122:0:14325:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf5356ae000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1785390250.392131:0:14325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf5356ae000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1785390250.392134:0:14325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf5356ae000 4 00010000:00080000:2.0:1785390250.392168:0:14325:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf503ea2800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.154@tcp at head 00010000:00010000:2.0:1785390250.408510:0:14325:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1785390250.408644:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1785390250.408679:0:14325:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1785390250.408693:0:14325:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x33dffe75ff5edd51 00000100:00080000:2.0:1785390250.408702:0:14325:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1785390250.408709:0:14325:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cf503ea2800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1785390250.408741:0:14325:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fc85f80 x1872116879301632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785390250.408791:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879301632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785390250.408852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1785390250.408908:0:14325:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1785390250.411698:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301632 00000100:00100000:3.0:1785390250.411710:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301632 00000100:00100000:3.0:1785390250.411761:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390250.411769:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872116879301632:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1785390250.411850:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872116879301632:12345-0@lo:38:llog_process_th.0 Request processed in 79us (2996us total) trans 0 rc -11/-11 00000100:00100000:3.0:1785390250.411857:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390250.411898:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785390250.411907:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf503ea2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785390250.411911:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1785390250.411915:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879301632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785390250.420202:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14325:1872116879301760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1785390250.420277:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390250.420318:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50608e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.420850:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301760 00000100:00100000:3.0:1785390250.420858:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301760 00000100:00100000:3.0:1785390250.420901:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1785390250.420910:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14325:x1872116879301760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1785390250.421146:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14325:x1872116879301760:12345-0@lo:502:llog_process_th.0 Request processed in 236us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.421153:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1785390250.422349:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:374ce4d4-733e-4fe2-9421-711e41cbfd01:14325:1872116879301760:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1785390250.422379:0:14325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1785390250.422550:0:14277:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1785390250.422566:0:14277:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1785390250.422765:0:14277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd43 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.422777:0:14277:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5600/0x33dffe75ff5edd3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd43 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1785390250.422832:0:14277:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1785390250.422835:0:14277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785390250.422836:0:14277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785390250.422838:0:14277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785390250.422839:0:14277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785390250.422840:0:14277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785390250.422842:0:14277:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785390250.422843:0:14277:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785390250.422845:0:14277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785390250.422847:0:14277:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785390250.422851:0:14277:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1785390250.422854:0:14277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785390250.422855:0:14277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785390250.422856:0:14277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785390250.422857:0:14277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785390250.422858:0:14277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785390250.422860:0:14277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785390250.422861:0:14277:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785390250.422862:0:14277:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785390250.422863:0:14277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785390250.422864:0:14277:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1785390250.422881:0:14277:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1785390250.422896:0:14277:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1785390250.422946:0:14277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390250.422969:0:14277:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562540 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.423794:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879301888 00000100:00100000:3.0:1785390250.423799:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879301888 00000100:00100000:3.0:1785390250.423831:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785390250.423838:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14277:x1872116879301888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1785390250.423858:0:14288:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1785390250.423869:0:14288:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1785390250.561149:0:14288:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785390250.561176:0:14288:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1785390250.561395:0:14311:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1785390250.561401:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1785390250.561452:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.561485:0:14311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.561495:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.561601:0:14311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.561619:0:14311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 12 pid: 14288 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.561636:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14311:1872116879302016:0@lo:104: 00000100:00100000:1.0:1785390250.561715:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390250.561797:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390250.562756:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302016 00000100:00100000:3.0:1785390250.562765:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302016 00000100:00100000:3.0:1785390250.562808:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390250.562817:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14311:x1872116879302016:12345-0@lo:104: 00010000:00010000:3.0:1785390250.562829:0:14278:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.562884:0:14278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785390250.562890:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14311:x1872116879302016:12345-0@lo:104: Request processed in 75us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.562897:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1785390250.562917:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390250.562923:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.562931:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390250.562947:0:14284:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.562957:0:14284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390250.562963:0:14284:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390250.562968:0:14284:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785390250.562996:0:14284:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563003:0:14284:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390250.563041:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563049:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4a00/0x33dffe75ff5edd20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd27 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563066:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390250.563069:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390250.563070:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390250.563211:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879302144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390250.563258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390250.563317:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302144 00000100:00100000:3.0:1785390250.563322:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302144 00010000:00010000:3.0:1785390250.563338:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 13 pid: 14288 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390250.563360:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390250.563366:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+13:3309:x1872116879302144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390250.563376:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390250.563381:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 13 pid: 14288 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563391:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 13 pid: 14288 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563408:0:14280:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563415:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785390250.563437:0:14280:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002037472s 00010000:00010000:3.0:1785390250.563442:0:14280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563448:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563454:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563487:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563493:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390250.563497:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563504:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563514:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390250.563555:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390250.563801:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402232d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+13:3309:x1872116879302144:12345-0@lo:103:ldlm_bl.0 Request processed in 434us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390250.563808:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390250.563906:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879302144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390250.564377:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5a00/0x33dffe75ff5edd27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5edd20 expref: 12 pid: 14288 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390250.564388:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14311:1872116879302016:0@lo:104: 00010000:00010000:1.0:1785390250.564403:0:14311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.564411:0:14311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.564418:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.564424:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edd58 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390250.647236:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390250.647878:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14277:x1872116879301888:12345-0@lo:253:mount.lustre.0 Request processed in 224035us (224927us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390250.647890:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1785390250.648111:0:14277:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14277:1872116879301888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785390250.648130:0:14277:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1785390250.648133:0:14277:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785390250.648135:0:14277:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1785390250.648136:0:14277:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785390250.648138:0:14277:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785390250.648139:0:14277:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785390250.648140:0:14277:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785390250.648141:0:14277:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1785390250.648142:0:14277:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1785390250.648144:0:14277:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785390250.648145:0:14277:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1785390250.648157:0:14277:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1785390250.651281:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1785390250.651432:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1785390250.667298:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1785390250.667489:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1785390250.669157:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1785390250.670186:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1785390250.691499:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1785390250.692213:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1785390250.695136:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1785390250.695454:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1785390250.696853:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1785390250.697048:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1785390250.775250:0:14277:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1785390250.779807:0:14277:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1785390250.780143:0:14333:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1785390250.780148:0:14333:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1785390250.780840:0:14334:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1785390250.780928:0:14334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785390250.791798:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1785390250.791862:0:14334:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1785390250.791866:0:14334:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1785390250.797795:0:14277:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1785390250.798220:0:14277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1785390250.799835:0:14277:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1785390250.799848:0:14277:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1785390250.800174:0:14277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1785390250.805404:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1785390250.808434:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1785390250.808487:0:14277:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1785390250.816317:0:14277:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1785390250.844980:0:14277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1785390251.043068:0:14277:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1785390251.043107:0:14277:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac6640e33988 00100000:10000000:3.0:1785390251.043115:0:14277:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1785390251.049143:0:14277:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1785390251.049166:0:14277:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1785390251.049190:0:14277:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1785390251.049218:0:14277:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1785390251.478365:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1785390251.613257:0:14292:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1785390251.613275:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf5356ae000 from 6 10000000:01000000:2.0:1785390251.613279:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1785390251.613326:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390251.613338:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390251.613349:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390251.613375:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879302272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785390251.613441:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390251.613488:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535970f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390251.616677:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302272 00000100:00100000:3.0:1785390251.616691:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302272 00000100:00100000:3.0:1785390251.616759:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1785390251.616769:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14292:x1872116879302272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390251.616785:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390251.616801:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edd5f expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390251.616838:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 12 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390251.616849:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 12 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390251.616859:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc5c00, rc 0) 00000100:00100000:3.0:1785390251.616933:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879302272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390251.616940:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1785390251.617070:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879302272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390251.617090:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390251.617101:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390251.617166:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879302400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1785390251.617207:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390251.617245:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535970f00 going to sleep for 11 seconds 00000100:00100000:1.0:1785390251.617294:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302400 00000100:00100000:1.0:1785390251.617299:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302400 00000100:00100000:1.0:1785390251.617332:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1785390251.617340:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879302400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1785390251.617354:0:14288:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1785390251.617369:0:14288:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1785390251.617372:0:14288:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1785390251.617445:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879302400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390251.617451:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1785390251.617545:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879302400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1785390251.617583:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1785390251.617590:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390251.617608:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390251.676053:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785390252.502910:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785390252.719969:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390253.717700:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390254.747358:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1785390255.639119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785390255.639134:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1785390255.639137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1785390255.639140:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1785390255.639143:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1785390255.639146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1785390255.639149:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf503ea2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1785390255.639160:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cf503ea2800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:0.0:1785390255.639182:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402d0fb80 x1872116879302656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785390255.639334:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879302528:0@lo:400:kworker.0 00000100:00100000:2.0:1785390255.639398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390255.639458:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302528 00000100:00100000:2.0:1785390255.639464:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302528 00000100:00100000:2.0:1785390255.639501:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785390255.639508:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:3310:x1872116879302528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390255.639607:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:3310:x1872116879302528:12345-0@lo:400:kworker.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390255.639614:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1785390255.639656:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879302528:0@lo:400:kworker.0 00000100:00100000:2.0:1785390255.640116:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879302656:0@lo:38:kworker.0 00000100:00100000:2.0:1785390255.640450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390255.645008:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302656 00000100:00100000:0.0:1785390255.645021:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302656 00000100:00100000:0.0:1785390255.645064:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390255.645072:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1872116879302656:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1785390255.645099:0:14297:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:0.0:1785390255.645325:0:14297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x33dffe75ff5edd6d 00000004:00100000:0.0:1785390255.645342:0:14297:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785390255.645467:0:14297:0:(import.c:65:import_set_state_nolock()) ffff8cf402d26000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390255.645825:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1872116879302656:12345-0@lo:38:kworker.0 Request processed in 751us (5373us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390255.645833:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1785390255.654362:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf402d0fb80 x1872116879302656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785390265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785390255.654384:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1785390255.654391:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1785390255.654396:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785390255.654399:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf503ea2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785390255.654404:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1872116879302656:0@lo:38:kworker.0 00010000:00010000:3.0:1785390255.765719:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390256.790093:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390257.816767:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390258.841290:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1785390259.056049:0:14578:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1785390259.861683:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390260.757677:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390250/real 1785390250] req@ffff8cf402d0d180 x1872116879299968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390260.757710:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf402d0d180 x1872116879299968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390260 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390260.757759:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390250/real 1785390250] req@ffff8cf402d0e680 x1872116879299840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390260 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390260.757771:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf402d0e680 x1872116879299840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390260 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1785390260.757787:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785390260.757808:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1785390260.757811:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879299968:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1785390260.757817:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf509226000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785390260.757822:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1785390260.757825:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879299840:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1785390260.758020:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785390260.758025:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1785390260.758027:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf509226000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785390260.758032:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1785390260.758037:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1785390260.758043:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf509226000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785390260.758061:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402230700 x1872116879302912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785390260.758071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785390260.758074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785390260.758075:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785390260.758078:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1785390260.758081:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1785390260.758091:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785390260.758102:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402232300 x1872116879303040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785390260.758144:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879303168:0@lo:400:kworker.0 00000100:00100000:3.0:1785390260.758207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390260.758256:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785390260.758262:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879302784:0@lo:400:kworker.0 00000100:00100000:3.0:1785390260.758287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390260.758314:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879302784 00000100:00100000:3.0:1785390260.758322:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879302784 00000100:00100000:3.0:1785390260.758355:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785390260.758363:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:3308:x1872116879302784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390260.758402:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:3308:x1872116879302784:12345-0@lo:400:kworker.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390260.758409:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1785390260.758458:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879302784:0@lo:400:kworker.0 00000100:00100000:3.0:1785390260.758493:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303168 00000100:00100000:3.0:1785390260.758496:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303168 00000100:00100000:3.0:1785390260.758519:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1785390260.758546:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879303168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390260.758584:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879303168:12345-0@lo:400:kworker.0 Request processed in 59us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390260.758590:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1785390260.758617:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf402230380 x1872116879303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390260.758640:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879303168:0@lo:400:kworker.0 00000100:00100000:2.0:1785390260.759255:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879302912:0@lo:8:kworker.0 00000400:00000100:2.0:1785390260.759280:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872116879302912 offset 0 length 520: 4 00000100:00100000:2.0:1785390260.759299:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879303040:0@lo:8:kworker.0 00000400:00000100:2.0:1785390260.759311:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1872116879303040 offset 0 length 520: 4 00010000:00010000:1.0:1785390260.886675:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390261.909685:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785390262.744560:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785390262.942764:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390263.958712:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785390264.038368:0:14729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe80212930 20000000:00000080:0.0:1785390264.038383:0:14729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf536969400 uarg=0000000000000000 20000000:01000000:0.0:1785390264.038414:0:14729:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1785390264.038420:0:14729:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1785390264.038424:0:14729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1785390264.044958:0:14730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1785390264.045198:0:14729:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1785390264.061472:0:14729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1785390264.061921:0:14729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390264.061941:0:14729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390264.061965:0:14729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390264.062006:0:14729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390264.062020:0:14729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 11 pid: 14289 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390264.062034:0:14729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14729:1872116879303296:0@lo:104: 00000100:00100000:2.0:1785390264.062092:0:14729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390264.062142:0:14729:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1785390264.062214:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303296 00000100:00100000:1.0:1785390264.062221:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303296 00000100:00100000:1.0:1785390264.062269:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390264.062287:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14729:x1872116879303296:12345-0@lo:104: 00010000:00010000:1.0:1785390264.062299:0:14279:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.062401:0:14279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785390264.062409:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14729:x1872116879303296:12345-0@lo:104: Request processed in 124us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390264.062417:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1785390264.062423:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390264.062429:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390264.062437:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4e00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:1.0:1785390264.062442:0:14283:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390264.062450:0:14283:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1785390264.062458:0:14283:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390264.062463:0:14283:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1785390264.062489:0:14729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14729:1872116879303296:0@lo:104: 00010000:00010000:2.0:1785390264.062506:0:14729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.062677:0:14283:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.062685:0:14283:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1785390264.062713:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.062719:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4e00/0x33dffe75ff5edd2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd35 expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.062735:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390264.062742:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390264.062743:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390264.062775:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390264.062786:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879303424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785390264.062811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390264.062918:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303424 00000100:00100000:0.0:1785390264.062923:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303424 00010000:00010000:0.0:1785390264.062941:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 12 pid: 14289 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390264.062969:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390264.062975:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:3310:x1872116879303424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390264.062984:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390264.062989:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 12 pid: 14289 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063000:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 12 pid: 14289 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063013:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5edd35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5edd2e expref: 12 pid: 14289 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063025:0:14280:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063032:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063044:0:14280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063051:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063057:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063069:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063074:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121da00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390264.063078:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063085:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063102:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390264.063110:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390264.063155:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:3310:x1872116879303424:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390264.063161:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390264.063207:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879303424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1785390264.063238:0:14729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390264.063246:0:14729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390264.063252:0:14729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121da00/0x33dffe75ff5edd74 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390264.981736:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785390265.621603:0:14292:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1785390265.621621:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5356ae000 from 10 10000000:01000000:3.0:1785390265.621627:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785390265.621674:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390265.621686:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390265.621696:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390265.621730:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879303552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785390265.621794:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390265.621851:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf541cf8300 going to sleep for 11 seconds 00000100:00100000:2.0:1785390265.621957:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303552 00000100:00100000:2.0:1785390265.621971:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303552 00000100:00100000:2.0:1785390265.622024:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1785390265.622034:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+11:14292:x1872116879303552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390265.622047:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390265.622060:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edd7b expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390265.622082:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390265.622092:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390265.622102:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c600, rc 0) 00000100:00100000:2.0:1785390265.622155:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879303552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390265.622162:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785390265.622321:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879303552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390265.622337:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390265.622345:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390265.622417:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879303680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390265.622444:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390265.622468:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a01d780 going to sleep for 11 seconds 00000100:00100000:2.0:1785390265.622746:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303680 00000100:00100000:2.0:1785390265.622751:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303680 00000100:00100000:2.0:1785390265.622782:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785390265.622789:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879303680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390265.623062:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879303680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390265.623069:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1785390265.623100:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879303680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390265.623128:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879303808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785390265.623161:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390265.623178:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1785390265.623188:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303808 00000100:00100000:2.0:1785390265.623191:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303808 00000100:00100000:2.0:1785390265.623205:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785390265.623210:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879303808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785390265.623328:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14292:x1872116879303808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390265.623335:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1785390265.623547:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879303808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1785390265.624312:0:14768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1785390265.637537:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1785390265.637593:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785390265.637603:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390265.637626:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1785390265.877799:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785390265.877808:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1785390265.877811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785390265.877813:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1785390265.877871:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1785390265.877885:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879303936:0@lo:400:kworker.0 00000100:00100000:1.0:1785390265.877952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390265.878021:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879303936 00000100:00100000:1.0:1785390265.878029:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879303936 00000100:00100000:1.0:1785390265.878071:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390265.878079:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879303936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390265.878130:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879303936:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390265.878138:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1785390265.878176:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf53fee4380 x1872116879303936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390265.878190:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879303936:0@lo:400:kworker.0 00010000:00010000:0.0:1785390266.012958:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390267.030792:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390268.058733:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390269.081442:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390270.101717:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785390270.200790:0:14930:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785390270.200793:0:14930:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1785390270.200917:0:14930:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cf503ea7800 00000020:01000004:2.0:1785390270.200945:0:14930:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1785390270.200956:0:14930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1785390270.200969:0:14930:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cf536a319c0) 00000020:00000080:2.0:1785390270.200982:0:14930:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1785390270.250020:0:14930:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785390270.250319:0:14930:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1785390270.258432:0:14930:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785390270.258757:0:14930:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1785390270.258958:0:14930:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1785390270.259338:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 513: rc = 0 00100000:10000000:2.0:1785390270.259447:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:2.0:1785390270.259560:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 513: rc = 0 00100000:10000000:2.0:1785390270.260090:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 349: rc = 0 00100000:10000000:2.0:1785390270.260379:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 349: rc = 0 00100000:10000000:3.0:1785390270.268173:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 349: rc = 0 00100000:10000000:3.0:1785390270.268458:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 349: rc = 0 00100000:10000000:3.0:1785390270.268811:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 349: rc = 0 00100000:10000000:3.0:1785390270.269052:0:14930:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 349: rc = 0 00000020:00000080:3.0:1785390270.270962:0:14930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1785390270.270974:0:14930:0:(osd_handler.c:1572:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785390270.271000:0:14930:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33dffe75ff5edd90 00000020:01000004:3.0:1785390270.271007:0:14930:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1785390270.271033:0:14930:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785390270.271037:0:14930:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785390270.271042:0:14930:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1785390270.271047:0:14930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1785390270.271058:0:14930:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cf53f4219c0) 00000020:00000080:3.0:1785390270.271078:0:14930:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1785390270.274265:0:14930:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785390270.274428:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1785390270.274434:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1785390270.287972:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1785390270.287988:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1785390270.298595:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1785390270.298608:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1785390270.299945:0:14930:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785390270.300110:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1785390270.300115:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1785390270.302642:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1785390270.302652:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1785390270.357991:0:14930:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1785390270.358203:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1785390270.358208:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1785390270.367434:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1785390270.367448:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1785390270.383393:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1785390270.383409:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1785390270.385317:0:14930:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1785390270.385472:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1785390270.385477:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1785390270.389715:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1785390270.389725:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1785390270.495479:0:14930:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1785390270.500969:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1785390270.500977:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1785390270.503430:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1785390270.503441:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1785390270.511322:0:14930:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1785390270.511346:0:14930:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1785390270.511352:0:14930:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1785390270.550334:0:14930:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1785390270.550381:0:14930:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.154@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1785390270.550385:0:14930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1785390270.550387:0:14930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785390270.550388:0:14930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785390270.550389:0:14930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785390270.550391:0:14930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785390270.550392:0:14930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785390270.550393:0:14930:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785390270.550396:0:14930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785390270.550397:0:14930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785390270.550401:0:14930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1785390270.550403:0:14930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785390270.550404:0:14930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1785390270.550405:0:14930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785390270.550412:0:14930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785390270.550413:0:14930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785390270.550414:0:14930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785390270.550414:0:14930:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785390270.550415:0:14930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785390270.550416:0:14930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1785390270.550456:0:14930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1785390270.550476:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304064:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1785390270.550839:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390270.550899:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf535970a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390270.552830:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304064 00000100:00100000:2.0:1785390270.552842:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304064 00000100:00100000:2.0:1785390270.552905:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1785390270.552915:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14930:x1872116879304064:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785390270.552963:0:14288:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1785390270.552966:0:14288:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1785390270.552970:0:14288:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1785390270.564352:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14930:x1872116879304064:12345-0@lo:253:mount.lustre.0 Request processed in 11431us (13506us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390270.564365:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1785390270.564438:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1785390270.564454:0:14930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1785390270.564458:0:14930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1785390270.564459:0:14930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1785390270.564461:0:14930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785390270.564462:0:14930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785390270.564464:0:14930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785390270.564465:0:14930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785390270.564466:0:14930:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785390270.564468:0:14930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785390270.564470:0:14930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1785390270.564488:0:14930:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf503ea7800 from lustre-OST0000 10000000:01000000:3.0:1785390270.564512:0:14930:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1785390270.564515:0:14930:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1785390270.564521:0:14930:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf53fea4d40 local copy 00010000:00010000:3.0:1785390270.564550:0:14930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390270.564789:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390270.564825:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.564862:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562780 going to sleep for 11 seconds 00000100:00100000:0.0:1785390270.565791:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304192 00000100:00100000:0.0:1785390270.565799:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304192 00000100:00100000:0.0:1785390270.565846:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785390270.565853:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14930:x1872116879304192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785390270.566063:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14930:x1872116879304192:12345-0@lo:501:mount.lustre.0 Request processed in 208us (1236us total) trans 0 rc -2/-2 00000100:00100000:0.0:1785390270.566071:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1785390270.566170:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304192:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1785390270.566185:0:14930:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1785390270.567001:0:14930:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1785390270.567010:0:14930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.567021:0:14930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390270.567057:0:14930:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf503ea7800 10000000:01000000:3.0:1785390270.567208:0:14930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1785390270.567214:0:14930:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cf53fea4d40 10000000:01000000:3.0:1785390270.567217:0:14930:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1785390270.567220:0:14930:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8cf53fea4d40 from 1 10000000:01000000:3.0:1785390270.567223:0:14930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1785390270.567252:0:14930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.567260:0:14930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.567269:0:14930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390270.567299:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785390270.567473:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.567505:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562780 going to sleep for 11 seconds 00000100:00100000:0.0:1785390270.568103:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304320 00000100:00100000:0.0:1785390270.568111:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304320 00000100:00100000:0.0:1785390270.568155:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785390270.568163:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+12:14930:x1872116879304320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785390270.568175:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390270.568189:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716600/0x33dffe75ff5edda5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edd9e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.568208:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716600/0x33dffe75ff5edda5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edd9e expref: 13 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.568857:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716600/0x33dffe75ff5edda5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd9e expref: 13 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.568867:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716600, rc 0) 00000100:00100000:2.0:1785390270.569928:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+13:14930:x1872116879304320:12345-0@lo:101:mount.lustre.0 Request processed in 1762us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390270.569937:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1785390270.569985:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390270.570003:0:14930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edda5 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.570013:0:14930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edda5 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390270.570032:0:14930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1785390270.570038:0:14930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edda5 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.570046:0:14930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4200/0x33dffe75ff5edd9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edda5 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390270.570052:0:14930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1785390270.570068:0:14930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1785390270.570075:0:14930:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1785390270.570077:0:14930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1785390270.570098:0:14930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.570105:0:14930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.570114:0:14930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390270.570138:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785390270.570167:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.570206:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53f562780 going to sleep for 11 seconds 00000100:00100000:1.0:1785390270.570551:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304448 00000100:00100000:1.0:1785390270.570557:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304448 00000100:00100000:1.0:1785390270.570605:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1785390270.570613:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+13:14930:x1872116879304448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390270.570624:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390270.570635:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf535ef4a00/0x33dffe75ff5eddb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eddac expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.570651:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf535ef4a00/0x33dffe75ff5eddb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eddac expref: 14 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.570666:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf535ef4a00/0x33dffe75ff5eddb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eddac expref: 14 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.570674:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4a00, rc 0) 00000100:00100000:1.0:1785390270.570704:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304448:12345-0@lo:101:mount.lustre.0 Request processed in 92us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.570710:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1785390270.571333:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785390270.571346:0:14930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eddb3 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.571354:0:14930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eddb3 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390270.572408:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1785390270.574182:0:14930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785390270.575089:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1785390270.575138:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1785390270.575182:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1785390270.575225:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1785390270.575263:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1785390270.575297:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1785390270.577265:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1785390270.577283:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1785390270.577974:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390270.578035:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390270.578199:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de506c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390270.578366:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304576 00000100:00100000:2.0:1785390270.578374:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304576 00000100:00100000:2.0:1785390270.578421:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1785390270.578429:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390270.578804:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304576:12345-0@lo:501:mount.lustre.0 Request processed in 374us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390270.578812:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1785390270.582947:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785390270.583011:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1785390270.583084:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390270.583125:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bda80 going to sleep for 11 seconds 00000100:00100000:3.0:1785390270.583179:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304704 00000100:00100000:3.0:1785390270.583186:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304704 00000100:00100000:3.0:1785390270.583234:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1785390270.583242:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785390270.583728:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304704:12345-0@lo:503:mount.lustre.0 Request processed in 485us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390270.583736:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1785390270.585355:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1785390270.586101:0:14930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785390270.586169:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785390270.586291:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390270.586339:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1785390270.586409:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304832 00000100:00100000:1.0:1785390270.586416:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304832 00000100:00100000:1.0:1785390270.586493:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785390270.586502:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390270.586736:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304832:12345-0@lo:502:mount.lustre.0 Request processed in 235us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.586744:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1785390270.586884:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785390270.587082:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1785390270.587143:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1785390270.588407:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1785390270.588481:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1785390270.588547:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1785390270.588591:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1785390270.588639:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1785390270.588794:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1785390270.588836:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1785390270.588884:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1785390270.588923:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1785390270.588968:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1785390270.589003:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785390270.589057:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.599681:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879304960 00000100:00100000:2.0:1785390270.599696:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879304960 00000100:00100000:1.0:1785390270.602197:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1785390270.602217:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390270.602492:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879304960:12345-0@lo:502:mount.lustre.0 Request processed in 283us (13433us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.602499:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1785390270.603014:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bda80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390270.603055:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879304960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785390270.603174:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1785390270.603192:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1785390270.610374:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1785390270.610385:0:14944:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1785390270.610393:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.610395:0:14944:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1785390270.610400:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1785390270.610415:0:14944:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cf50e2c4d40) 00000020:00000080:0.0:1785390270.610437:0:14944:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1785390270.610441:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1785390270.610518:0:14944:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf503ea7800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1785390270.610548:0:14944:0:(osd_handler.c:1572:osd_obd_connect()) connect #1 00000020:00000080:0.0:1785390270.610556:0:14944:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33dffe75ff5eddc1 00010000:00010000:1.0:1785390270.620257:0:14944:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1785390270.629299:0:14944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1785390270.631025:0:14944:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1785390270.642778:0:14944:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1785390270.642790:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390270.642796:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.642799:0:14944:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1785390270.642802:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1785390270.642810:0:14944:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1785390270.642812:0:14944:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785390270.642814:0:14944:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1785390270.642816:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1785390270.642819:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.642820:0:14944:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1785390270.642823:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390270.642826:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.642827:0:14944:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1785390270.642830:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1785390270.642832:0:14944:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1785390270.642834:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390270.642836:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.642837:0:14944:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1785390270.642840:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1785390270.642842:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.642843:0:14944:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1785390270.642846:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1785390270.642911:0:14944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1785390270.642915:0:14944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1785390270.642917:0:14944:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1785390270.642920:0:14944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1785390270.643116:0:14930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1785390270.643146:0:14930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1785390270.643168:0:14930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eddb3 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.643179:0:14930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5a00/0x33dffe75ff5eddac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eddb3 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390270.643187:0:14930:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf503ea7800 from 1 10000000:01000000:3.0:1785390270.643189:0:14930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1785390270.643232:0:14930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.643240:0:14930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.643261:0:14930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390270.643282:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1785390270.643345:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.643382:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5354e9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390270.643785:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305088 00000100:00100000:3.0:1785390270.643793:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305088 00000100:00100000:3.0:1785390270.643838:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785390270.643848:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+14:14930:x1872116879305088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390270.643861:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390270.643872:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eddc8 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.643896:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 15 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.643907:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 15 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.643915:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4000, rc 0) 00000100:00100000:3.0:1785390270.643955:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305088:12345-0@lo:101:mount.lustre.0 Request processed in 109us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390270.643962:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1785390270.644007:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390270.644021:0:14930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.644037:0:14930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785390270.645090:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1785390270.651181:0:14930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1785390270.651448:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1785390270.651507:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1785390270.651608:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1785390270.651618:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1785390270.652058:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390270.652119:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.652164:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5354e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1785390270.652206:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305216 00000100:00100000:2.0:1785390270.652213:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305216 00000100:00100000:2.0:1785390270.652268:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1785390270.652277:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390270.652479:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305216:12345-0@lo:501:mount.lustre.0 Request processed in 202us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390270.652486:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1785390270.653847:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390270.653885:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785390270.653928:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.653947:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5354e9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1785390270.654006:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305344 00000100:00100000:1.0:1785390270.654011:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305344 00000100:00100000:1.0:1785390270.654054:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785390270.654061:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390270.654206:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305344:12345-0@lo:503:mount.lustre.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.654272:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1785390270.655872:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785390270.656644:0:14930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785390270.656713:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785390270.656779:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.656816:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0600 going to sleep for 11 seconds 00000100:00100000:3.0:1785390270.656849:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305472 00000100:00100000:3.0:1785390270.656856:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305472 00000100:00100000:3.0:1785390270.656897:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1785390270.656906:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785390270.657069:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305472:12345-0@lo:502:mount.lustre.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390270.657076:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1785390270.657947:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785390270.660717:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1785390270.661743:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1785390270.661812:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1785390270.661859:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1785390270.661910:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1785390270.661969:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1785390270.662001:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1785390270.662044:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1785390270.662091:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785390270.662169:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.667686:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305600 00000100:00100000:2.0:1785390270.667700:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305600 00000100:00100000:0.0:1785390270.668111:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1785390270.668123:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785390270.668384:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305600:12345-0@lo:502:mount.lustre.0 Request processed in 263us (6213us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390270.668391:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1785390270.670864:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5354e9300 going to sleep for 11 seconds 00000100:00100000:2.0:1785390270.670986:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785390270.671149:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1785390270.671164:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1785390270.672854:0:14948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785390270.672865:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785390270.672868:0:14948:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1785390270.672875:0:14948:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf503ea7800 00000020:00000080:3.0:1785390270.672877:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785390270.672884:0:14948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785390270.672887:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785390270.672888:0:14948:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1785390270.672890:0:14948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785390270.672892:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785390270.672893:0:14948:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1785390270.672897:0:14948:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf503ea7800 00000020:00000080:3.0:1785390270.672899:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785390270.672998:0:14948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785390270.673002:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785390270.673004:0:14948:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1785390270.673006:0:14948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1785390270.673008:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785390270.673009:0:14948:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1785390270.673012:0:14948:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf503ea7800 00000020:00000080:3.0:1785390270.673013:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1785390270.673044:0:14948:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1785390270.673046:0:14948:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1785390270.673047:0:14948:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1785390270.673050:0:14948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1785390270.673169:0:14930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1785390270.673190:0:14930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785390270.673316:0:14930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.673330:0:14930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785390270.673377:0:14930:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1785390270.673380:0:14930:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf503ea7800 10000000:01000000:0.0:1785390270.673383:0:14930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf503ea7800 10000000:01000000:0.0:1785390270.673387:0:14930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1785390270.673392:0:14930:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf503ea7800 from 1 10000000:01000000:0.0:1785390270.673395:0:14930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1785390270.673425:0:14930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.673433:0:14930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.673443:0:14930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390270.673463:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785390270.673518:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390270.673586:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1785390270.673601:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305728 00000100:00100000:1.0:1785390270.673608:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305728 00000100:00100000:1.0:1785390270.673970:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1785390270.673982:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879305728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390270.673995:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390270.674007:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edddd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5eddd6 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.674029:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5eddd6 expref: 16 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.674040:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf535ef4400/0x33dffe75ff5edddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eddd6 expref: 16 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.674049:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4400, rc 0) 00000100:00100000:1.0:1785390270.674098:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879305728:12345-0@lo:101:mount.lustre.0 Request processed in 119us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.674104:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1785390270.674880:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390270.674903:0:14930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edddd expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.674913:0:14930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edddd expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1785390270.677094:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1785390270.679638:0:14930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785390270.680079:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1785390270.680119:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1785390270.680147:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1785390270.680200:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1785390270.680238:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1785390270.680286:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1785390270.681966:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1785390270.682033:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1785390270.682094:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1785390270.682131:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1785390270.682167:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1785390270.682215:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1785390270.682251:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1785390270.682285:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1785390270.683419:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1785390270.683465:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1785390270.683515:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1785390270.683586:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1785390270.683620:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1785390270.683648:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1785390270.683710:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1785390270.683748:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1785390270.683799:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1785390270.683859:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1785390270.684963:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1785390270.685003:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1785390270.685054:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1785390270.685092:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1785390270.685177:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1785390270.685184:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1785390270.685284:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390270.685357:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.685398:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0000 going to sleep for 11 seconds 00000100:00100000:3.0:1785390270.685596:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305856 00000100:00100000:3.0:1785390270.685611:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305856 00000100:00100000:3.0:1785390270.685660:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1785390270.685668:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879305856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1785390270.685978:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879305856:12345-0@lo:501:mount.lustre.0 Request processed in 310us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390270.685986:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1785390270.687397:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390270.687435:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390270.687472:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.687493:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0000 going to sleep for 11 seconds 00000100:00100000:1.0:1785390270.687950:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879305984 00000100:00100000:1.0:1785390270.687955:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879305984 00000100:00100000:1.0:1785390270.687985:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1785390270.687993:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879305984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390270.688133:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879305984:12345-0@lo:503:mount.lustre.0 Request processed in 141us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.688140:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1785390270.688229:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879305984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1785390270.689293:0:14930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1785390270.690977:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879306112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785390270.691034:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.691063:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0000 going to sleep for 11 seconds 00000100:00100000:1.0:1785390270.691413:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306112 00000100:00100000:1.0:1785390270.691419:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306112 00000100:00100000:1.0:1785390270.691454:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1785390270.691462:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879306112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390270.691703:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879306112:12345-0@lo:502:mount.lustre.0 Request processed in 240us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390270.691710:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1785390270.692874:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879306112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785390270.693139:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1785390270.693184:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1785390270.693213:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1785390270.693269:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1785390270.693308:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1785390270.693371:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1785390270.693405:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1785390270.693433:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1785390270.693486:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1785390270.693520:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1785390270.693585:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1785390270.693630:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1785390270.693663:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1785390270.693695:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1785390270.693740:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1785390270.693790:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1785390270.693839:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1785390270.693885:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1785390270.693920:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1785390270.693954:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1785390270.693999:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1785390270.694033:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1785390270.697049:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1785390270.697142:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1785390270.697172:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1785390270.697201:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1785390270.697249:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1785390270.697286:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1785390270.698402:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1785390270.698464:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1785390270.698496:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1785390270.698542:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1785390270.698608:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1785390270.698653:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1785390270.698682:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1785390270.698726:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1785390270.698774:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1785390270.703613:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1785390270.703795:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1785390270.703836:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1785390270.703883:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879306240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785390270.703958:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.704011:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0000 going to sleep for 11 seconds 00000100:00100000:3.0:1785390270.704141:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306240 00000100:00100000:3.0:1785390270.704148:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306240 00000100:00100000:3.0:1785390270.704196:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1785390270.704204:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879306240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785390270.704422:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879306240:12345-0@lo:502:mount.lustre.0 Request processed in 218us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390270.704429:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1785390270.706761:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879306240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1785390270.706852:0:14930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1785390270.706863:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1785390270.712758:0:14953:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1785390270.712776:0:14953:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cf53f423380) 00000020:00000080:3.0:1785390270.712798:0:14953:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1785390270.712945:0:14953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf503ea7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1785390270.712949:0:14953:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf503ea7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1785390270.712952:0:14953:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf503ea7800 3 00010000:00080000:3.0:1785390270.712995:0:14953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf50a8a2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1785390270.721766:0:14953:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1785390270.721871:0:14953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1785390270.721908:0:14953:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785390270.721919:0:14953:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x33dffe75ff5eddeb 00000100:00080000:3.0:1785390270.721929:0:14953:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785390270.721936:0:14953:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf50a8a2800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785390270.721971:0:14953:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402230000 x1872116879306368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785390270.721991:0:14953:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1785390270.722214:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785390270.722219:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1785390270.722222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785390270.722225:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1785390270.722273:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879306496:0@lo:400:kworker.0 00000100:00100000:0.0:1785390270.722968:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872116879306368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1785390270.723009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390270.723119:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306368 00000100:00100000:0.0:1785390270.723126:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306368 00000100:00100000:0.0:1785390270.723153:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785390270.723159:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1872116879306368:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1785390270.723179:0:14295:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:0.0:1785390270.723206:0:14295:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x33dffe75ff5eddf2 00000004:00100000:0.0:1785390270.723220:0:14295:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785390270.723252:0:14295:0:(import.c:65:import_set_state_nolock()) ffff8cf5034c7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390270.723296:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1872116879306368:12345-0@lo:38:llog_process_th.0 Request processed in 136us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390270.723303:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1785390270.724090:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf402230000 x1872116879306368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785390280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390270.724102:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1785390270.724109:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1785390270.724115:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1785390270.724119:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1785390270.724121:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf50a8a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1785390270.724127:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1872116879306368:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785390270.724199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390270.726971:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306496 00000100:00100000:0.0:1785390270.726982:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306496 00000100:00100000:0.0:1785390270.727024:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785390270.727033:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879306496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390270.727601:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879306496:12345-0@lo:400:kworker.0 Request processed in 568us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390270.727610:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1785390270.728293:0:14953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1785390270.728403:0:14930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1785390270.728426:0:14930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1785390270.728441:0:14930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edddd expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390270.728450:0:14930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503716400/0x33dffe75ff5eddd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edddd expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1785390270.728504:0:14930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1785390270.728507:0:14930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785390270.728508:0:14930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390270.728513:0:14930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390270.728514:0:14930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390270.728515:0:14930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390270.728517:0:14930:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785390270.728518:0:14930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390270.728519:0:14930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785390270.728537:0:14930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1785390270.728540:0:14930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1785390270.728541:0:14930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785390270.728542:0:14930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390270.728543:0:14930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390270.728544:0:14930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390270.728545:0:14930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390270.728546:0:14930:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785390270.728547:0:14930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390270.728548:0:14930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1785390270.728579:0:14930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1785390270.728595:0:14930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879306624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1785390270.728638:0:14930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390270.728667:0:14930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf52021b840 going to sleep for 11 seconds 00000100:00100000:2.0:1785390270.729296:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306624 00000100:00100000:2.0:1785390270.729302:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306624 00000100:00100000:2.0:1785390270.730442:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1785390270.730453:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14930:x1872116879306624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1785390270.730480:0:14290:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1785390270.730492:0:14290:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1785390270.731249:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf53fc87800 x1872116879306496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390270.731263:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879306496:0@lo:400:kworker.0 20000000:01000000:2.0:1785390270.856600:0:14290:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1785390270.856616:0:14290:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1785390270.856636:0:14311:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1785390270.856639:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1785390270.856662:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390270.856679:0:14311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 16 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390270.856688:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390270.856726:0:14311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 16 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390270.856740:0:14311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 16 pid: 14289 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390270.857032:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14311:1872116879306752:0@lo:104: 00000100:00100000:2.0:1785390270.857092:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390270.857172:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53ffc0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1785390270.860627:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306752 00000100:00100000:0.0:1785390270.860641:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306752 00000100:00100000:0.0:1785390270.860688:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785390270.860697:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14311:x1872116879306752:12345-0@lo:104: 00010000:00010000:0.0:1785390270.860714:0:14279:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390270.861945:0:14279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1785390270.861965:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14311:x1872116879306752:12345-0@lo:104: Request processed in 1269us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390270.861973:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1785390270.862399:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390270.862406:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.862415:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121cc00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390270.862419:0:14284:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.862428:0:14284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390270.862435:0:14284:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390270.862441:0:14284:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785390270.862481:0:14284:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.862488:0:14284:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390270.862541:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.862549:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf50121cc00/0x33dffe75ff5edd5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd66 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.862575:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390270.862577:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390270.862579:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390270.862608:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14311:1872116879306752:0@lo:104: 00010000:00010000:3.0:1785390270.862627:0:14311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390270.862835:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879306880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1785390270.862936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390270.863397:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879306880 00000100:00100000:3.0:1785390270.863402:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879306880 00010000:00010000:3.0:1785390270.863422:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 17 pid: 14289 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390270.863453:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785390270.863459:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:3308:x1872116879306880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390270.863469:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390270.863474:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 17 pid: 14289 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863485:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 17 pid: 14289 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863499:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc5c00/0x33dffe75ff5edd66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5edd5f expref: 17 pid: 14289 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863512:0:14280:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863555:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785390270.863579:0:14280:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006939477s 00010000:00010000:3.0:1785390270.863583:0:14280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863590:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863597:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863604:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863610:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121ce00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390270.863615:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863622:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863636:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863644:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390270.863677:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3308:x1872116879306880:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390270.863684:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785390270.863719:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879306880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390270.863736:0:14311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863744:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390270.863750:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121ce00/0x33dffe75ff5eddf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390270.901304:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14930:x1872116879306624:12345-0@lo:253:mount.lustre.0 Request processed in 170847us (172658us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390270.901318:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1785390270.901467:0:14930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:14930:1872116879306624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785390270.901482:0:14930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1785390270.901486:0:14930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785390270.901487:0:14930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1785390270.901489:0:14930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390270.901490:0:14930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390270.901491:0:14930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390270.901493:0:14930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390270.901494:0:14930:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785390270.901496:0:14930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390270.901497:0:14930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1785390270.901511:0:14930:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785390270.912681:0:14930:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785390270.913032:0:14930:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785390270.913188:0:14930:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785390270.914331:0:14930:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785390270.914520:0:14930:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1785390270.915426:0:14930:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1785390270.935412:0:14930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1785390271.111320:0:14930:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1785390271.111328:0:14930:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1785390271.111359:0:14930:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1785390271.111414:0:14930:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1785390271.111437:0:14930:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1785390271.111468:0:14930:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1785390271.127719:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390272.149734:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1785390272.469617:0:14292:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1785390272.469624:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf5356ae000 from 7 10000000:01000000:1.0:1785390272.469629:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1785390272.469671:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390272.469694:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390272.469707:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390272.469732:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879307008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1785390272.469796:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390272.469850:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1785390272.469965:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307008 00000100:00100000:3.0:1785390272.469973:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307008 00000100:00100000:3.0:1785390272.470025:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1785390272.470035:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+15:14292:x1872116879307008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390272.470048:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390272.470060:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ede00 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390272.470082:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 16 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390272.470092:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 16 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390272.470101:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf53ffc4a00, rc 0) 00000100:00100000:3.0:1785390272.470139:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14292:x1872116879307008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390272.470145:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1785390272.470228:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879307008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390272.470242:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390272.470250:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390272.470295:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879307136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1785390272.470392:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390272.470467:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50a0a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1785390272.470520:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307136 00000100:00100000:3.0:1785390272.470543:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307136 00000100:00100000:3.0:1785390272.470575:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1785390272.470581:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14292:x1872116879307136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1785390272.470594:0:14290:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1785390272.470608:0:14290:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1785390272.470611:0:14290:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1785390272.470675:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14292:x1872116879307136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390272.470682:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1785390272.470952:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879307136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1785390272.471001:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1785390272.471007:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390272.471015:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1785390272.982597:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785390273.174376:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390274.198844:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.223614:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390275.866461:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390260/real 1785390260] req@ffff8cf402230700 x1872116879302912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390275.866492:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf402230700 x1872116879302912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390275.866502:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785390260/real 1785390260] req@ffff8cf402232300 x1872116879303040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390275.866513:0:3306:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf402232300 x1872116879303040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1785390275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785390275.866555:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf509226000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785390275.866577:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1785390275.866580:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879302912:0@lo:8:kworker.0 00000100:00080000:3.0:1785390275.866586:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785390275.866590:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1785390275.866593:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879303040:0@lo:8:kworker.0 00000100:00080000:2.0:1785390275.866968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785390275.866973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1785390275.866976:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cf509226000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785390275.866981:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 569 00000100:00080000:2.0:1785390275.866986:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1785390275.866992:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf509226000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1785390275.867012:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fc87480 x1872116879307392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1785390275.867024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785390275.867027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1785390275.867030:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785390275.867033:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 569 00000100:00080000:2.0:1785390275.867035:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1785390275.867038:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1785390275.867049:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fc84a80 x1872116879307520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785390275.867094:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879307648:0@lo:400:kworker.0 00000100:00100000:2.0:1785390275.867148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390275.867190:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1785390275.867195:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879307264:0@lo:400:kworker.0 00000100:00100000:2.0:1785390275.867230:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390275.867257:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879307776:0@lo:400:kworker.0 00000100:00100000:2.0:1785390275.867295:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390275.867329:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307648 00000100:00100000:2.0:1785390275.867336:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307648 00000100:00100000:2.0:1785390275.867369:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307776 00000100:00100000:2.0:1785390275.867371:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307776 00000100:00100000:2.0:1785390275.867392:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785390275.867399:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390275.867442:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879307648:12345-0@lo:400:kworker.0 Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390275.867449:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785390275.867463:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785390275.867469:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879307776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390275.867494:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879307776:12345-0@lo:400:kworker.0 Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390275.867499:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785390275.867554:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1785390275.867576:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fc86680 x1872116879307776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390275.867589:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879307776:0@lo:400:kworker.0 00010000:00080000:2.0:1785390275.867607:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fc86a00 x1872116879307648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390275.867614:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879307648:0@lo:400:kworker.0 00000100:00100000:3.0:1785390275.867733:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879307392:0@lo:8:kworker.0 00000100:00100000:3.0:1785390275.867763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390275.867791:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879307520:0@lo:8:kworker.0 00000100:00100000:3.0:1785390275.867811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390275.867907:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307392 00000100:00100000:2.0:1785390275.867916:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307392 00000100:00100000:2.0:1785390275.867939:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307520 00000100:00100000:2.0:1785390275.867942:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307520 00000100:00100000:2.0:1785390275.867951:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390275.867955:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879307392:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1785390275.867975:0:14931:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:2.0:1785390275.867997:0:14931:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5ede0e 00002000:00100000:2.0:1785390275.868010:0:14931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cf51f0e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1785390275.868015:0:14931:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1785390275.868017:0:14931:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1785390275.868362:0:14931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785390275.868381:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785390275.868414:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1872116879307392:12345-0@lo:8:kworker.0 Request processed in 457us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390275.868420:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390275.868432:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1785390275.868436:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879307520:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1785390275.868444:0:14931:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1785390275.868465:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879307520:12345-0@lo:8:kworker.0 Request processed in 28us (653us total) trans 0 rc -19/-19 00000100:00100000:2.0:1785390275.868470:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1785390275.868558:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fc87480 x1872116879307392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785390295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390275.868566:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1785390275.868571:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1785390275.868577:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1785390275.868581:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1785390275.868583:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf509226000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1785390275.868597:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1785390275.868601:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879307392:0@lo:8:kworker.0 00000100:00080000:3.0:1785390275.868610:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1785390275.868613:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1785390275.868615:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879307520:0@lo:8:kworker.0 00000004:00080000:2.0:1785390275.868824:0:14318:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1785390275.868838:0:14318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14318:1872116879308032:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1785390275.868861:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390275.868873:0:14318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5118c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1785390275.868881:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390275.868893:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879307904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390275.868913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390275.874115:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307264 00000100:00100000:1.0:1785390275.874128:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307264 00000100:00100000:1.0:1785390275.874399:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1785390275.874409:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3310:x1872116879307264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390275.874490:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3310:x1872116879307264:12345-0@lo:400:kworker.0 Request processed in 84us (7259us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390275.874497:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1785390275.874639:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308032 00000100:00100000:2.0:1785390275.874644:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308032 00000100:00100000:2.0:1785390275.874680:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1785390275.874687:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1872116879308032:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1785390275.875263:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879307904 00000100:00100000:0.0:1785390275.875268:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879307904 00000100:00100000:0.0:1785390275.875304:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785390275.875311:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879307904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390275.875334:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390275.875371:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879307904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (6456us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390275.875376:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1785390275.878888:0:14317:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785390275.879847:0:14317:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584434321685ns, next at 0ns, rc = 0 00000100:00100000:0.0:1785390275.879908:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879307264:0@lo:400:kworker.0 00000100:00080000:2.0:1785390275.880016:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1785390275.880043:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fc86a00 x1872116879307904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390275.880063:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879307904:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1785390275.883978:0:14931:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1785390275.883987:0:14931:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1785390275.883991:0:14931:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1785390275.899253:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.899265:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901819:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.901825:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.901832:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901852:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901864:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901882:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901900:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390275.901911:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390275.901916:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901923:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.901928:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901938:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901954:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901962:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.901979:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.901980:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.901982:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785390275.905243:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.905264:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.905486:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.905491:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.905498:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.905512:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.905594:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.905602:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.905657:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785390275.906117:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.906123:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.906132:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.906135:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.906139:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.906147:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.906159:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.906166:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911428:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785390275.911440:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911453:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121da00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.911458:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911468:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911495:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911502:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d129cb/0x33dffe75ff5ede1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911554:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.911558:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911566:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.911569:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911576:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911586:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.911592:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.911594:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.911596:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.914779:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785390275.914791:0:14931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d91bdf3/0x33dffe75ff5ede23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390275.915337:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.915346:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.915358:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.915364:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.915369:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.915382:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.915391:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.915409:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.919356:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.919369:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.919395:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.919400:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.919411:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.919430:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.919445:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.919447:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.919449:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.921378:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785390275.921389:0:14931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f8854e/0x33dffe75ff5ede2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390275.921940:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.921947:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.921959:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.921963:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.921968:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.921980:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.921989:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.921997:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.924763:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.924773:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.924784:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.924789:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.924799:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.924815:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.924829:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.924832:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.924833:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.928582:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785390275.928596:0:14931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e01e7d0/0x33dffe75ff5ede31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390275.929159:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.929166:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929178:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.929182:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.929189:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929203:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929226:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929234:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929249:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785390275.929619:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.929624:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929638:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.929641:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.929645:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929655:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929663:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929671:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.929680:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1785390275.930043:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.930049:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930058:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.930060:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.930064:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930074:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930095:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930102:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930111:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1785390275.930485:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.930491:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930500:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.930503:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.930508:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930546:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930555:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930563:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930583:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1785390275.930938:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.930943:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930951:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.930954:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.930957:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930966:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930973:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930980:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.930987:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1785390275.931346:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.931352:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.931361:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.931368:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.931373:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.931382:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.931390:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.931398:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.931406:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1785390275.932170:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1785390275.932178:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932187:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.932191:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932200:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932218:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932226:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006fd07dd/0x33dffe75ff5ede38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932244:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1785390275.932248:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932254:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.932263:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932282:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932293:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932300:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a450143d/0x33dffe75ff5ede3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932311:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1785390275.932314:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932319:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.932321:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932328:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932335:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932340:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000352229be/0x33dffe75ff5ede46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932355:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1785390275.932359:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932364:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.932367:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932373:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932380:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932385:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd198452/0x33dffe75ff5ede4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932394:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785390275.932396:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932402:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121ca00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.932404:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932418:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932426:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932432:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab953b3d/0x33dffe75ff5ede54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932441:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.932443:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932448:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.932450:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932456:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932464:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932471:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faafe0b0/0x33dffe75ff5ede5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.932491:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.932493:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.932495:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.932501:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785390275.936177:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.936188:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.936204:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.936209:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.936214:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.936228:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.936238:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.936252:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.936364:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785390275.939546:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.939556:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.939570:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.939575:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.939580:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.939592:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.939601:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.939609:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.942798:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785390275.942810:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.942822:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.942827:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.942837:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.942854:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.942861:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c7a2cb/0x33dffe75ff5ede62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1785390275.942902:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1785390275.942992:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390275.942997:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.943016:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121ce00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390275.943019:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.943026:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.943039:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.943047:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.943049:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.943051:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.944403:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785390275.944413:0:14931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dffee72/0x33dffe75ff5ede69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390275.945037:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.945044:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.945057:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.945062:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.945067:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.945079:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.945088:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.945096:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.949581:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.949594:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.949618:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121cc00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.949623:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.949634:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.949652:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.949797:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.949800:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.949802:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.949904:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785390275.949911:0:14931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c991262c/0x33dffe75ff5ede70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1785390275.950485:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390275.950492:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.950510:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1785390275.950537:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390275.950543:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.950553:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.950561:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.950567:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.955655:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.955667:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.955679:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.955685:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.955697:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.955772:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.955791:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.955793:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.955795:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.955846:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1785390275.955854:0:14931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beed315f/0x33dffe75ff5ede77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.956379:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1785390275.969112:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1785390275.969125:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.969140:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=584s v=(0 0) 00010000:00010000:0.0:1785390275.969145:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390275.969150:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.969163:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.969173:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.969188:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.969203:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390275.969795:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.969803:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.969811:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.969815:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.969824:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.969839:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.969845:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069a38614/0x33dffe75ff5ede7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.969861:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.969863:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.969864:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.972382:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.972392:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972405:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.972410:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.972415:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972449:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972461:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972469:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972489:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390275.972556:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.972564:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.972576:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.972581:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.972589:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.972603:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.972610:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6c6ada8/0x33dffe75ff5ede85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.972632:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.972634:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.972636:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.972951:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.972957:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972966:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.972969:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.972973:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972982:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972990:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.972997:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973027:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785390275.973398:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.973404:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973413:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.973417:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.973421:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973441:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973450:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973457:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973477:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1785390275.973866:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.973872:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973880:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.973884:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.973888:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973896:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973904:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973920:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.973928:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1785390275.974604:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1785390275.974611:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974620:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.974624:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974644:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974657:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974665:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011519e8a/0x33dffe75ff5ede8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974682:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1785390275.974685:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974692:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.974695:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974704:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974722:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974730:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d25e903/0x33dffe75ff5ede93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974751:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390275.974755:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974762:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.974765:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974773:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974782:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974789:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037b052e5/0x33dffe75ff5ede9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.974799:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.974801:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.974803:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.975895:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.979283:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.979295:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.979309:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.979314:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.979320:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.979333:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.979342:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.979350:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.979373:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390275.979848:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390275.979855:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.979863:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.979874:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.979883:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.979898:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.979906:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa3875e/0x33dffe75ff5edea1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.979929:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.979931:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.979933:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.980595:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.980602:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.982094:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.982100:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.982105:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.982116:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.982125:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.982131:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.982144:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390275.982200:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390275.982207:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.982215:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390275.982219:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.982227:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.982239:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.982246:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaf9791d/0x33dffe75ff5edea8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.982266:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.982268:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.982269:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.984151:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.984160:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.984229:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.984233:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.984238:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.984248:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.984270:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.984278:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.984300:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390275.984351:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.984358:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.984365:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.984369:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.984377:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.984398:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.984405:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d521be06/0x33dffe75ff5edeaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.984424:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.984426:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.984428:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.985381:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.985388:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.985399:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.985403:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.985408:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.985418:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.985427:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.985435:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.985468:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390275.985788:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390275.985800:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.985809:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390275.985813:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.985822:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.985835:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.985843:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0943266/0x33dffe75ff5edeb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.985862:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.985863:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.985865:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.987427:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.987434:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.987445:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.987449:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.987454:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.987464:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.987472:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.987480:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.987503:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1785390275.989942:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.989951:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.989963:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.989973:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.989978:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.989989:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.989997:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.990841:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390275.990848:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.990856:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.990860:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.990868:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.990883:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.990896:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244063db/0x33dffe75ff5edebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.990915:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.990916:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.990918:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390275.991104:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.991126:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390275.991351:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390275.991356:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.991364:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390275.991367:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.991375:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.991387:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.991393:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000734ae89a/0x33dffe75ff5edec4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390275.991408:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.991409:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390275.991411:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.992695:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.992704:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.992715:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.992720:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.992725:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.992735:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.992743:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.992757:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.992773:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390275.993778:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390275.993784:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.993792:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390275.993795:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.993802:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.993813:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.993820:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000388daedc/0x33dffe75ff5edecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390275.993844:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.993845:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390275.993847:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1785390275.994316:0:14931:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1785390275.994323:0:14931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.994331:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=584s v=(0 0) 00010000:00010000:1.0:1785390275.994334:0:14931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390275.994338:0:14931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.994347:0:14931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.994354:0:14931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.994361:0:14931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390275.994381:0:14931:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1785390275.994571:0:14931:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:0.0:1785390275.994584:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390275.994589:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.994596:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390275.994599:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.994616:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.994628:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.994635:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000237fa863/0x33dffe75ff5eded2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390275.994650:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.994652:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390275.994654:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390275.995744:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1872116879308032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 121054us (126878us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390275.995763:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785390275.995805:0:14318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14318:1872116879308032:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1785390275.995820:0:14318:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1785390275.995863:0:14318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14318:1872116879308160:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1785390275.995897:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390275.995940:0:14318:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50480 going to sleep for 11 seconds 00000100:00100000:0.0:1785390275.995988:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308160 00000100:00100000:0.0:1785390275.995994:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308160 00000100:00100000:0.0:1785390275.996035:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785390275.996044:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14318:x1872116879308160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1785390275.996078:0:14934:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1785390276.004103:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14318:x1872116879308160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8053us (8198us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1785390276.004116:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1785390276.008397:0:14318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14318:1872116879308160:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1785390276.008416:0:14318:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1785390276.249252:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1785390276.251411:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1785390276.251457:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1785390277.275812:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390278.293705:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390279.320210:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785390279.715403:0:15297:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1785390280.349567:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1785390281.240055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1785390281.240064:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1785390281.240068:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1785390281.240079:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 584 00000100:00080000:2.0:1785390281.240086:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1785390281.240095:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:2.0:1785390281.240120:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fc86300 x1872116879308544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1785390281.240184:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879308288:0@lo:400:kworker.0 00000100:00100000:2.0:1785390281.240288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390281.240353:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785390281.240360:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879308416:0@lo:400:kworker.0 00000100:00100000:2.0:1785390281.240388:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390281.240421:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879308544:0@lo:8:kworker.0 00000100:00100000:2.0:1785390281.240445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390281.240486:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879308672:0@lo:400:kworker.0 00000100:00100000:2.0:1785390281.240515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390281.240572:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1785390281.240578:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879308800:0@lo:400:kworker.0 00000100:00100000:2.0:1785390281.240605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390281.240639:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308288 00000100:00100000:2.0:1785390281.240656:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308288 00000100:00100000:2.0:1785390281.240708:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785390281.240718:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3309:x1872116879308288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390281.240774:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3309:x1872116879308288:12345-0@lo:400:kworker.0 Request processed in 58us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390281.240783:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1785390281.240822:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308416 00000100:00100000:2.0:1785390281.240826:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308416 00000100:00100000:2.0:1785390281.240860:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308544 00000100:00100000:2.0:1785390281.240864:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308544 00000100:00100000:2.0:1785390281.240875:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390281.240880:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879308416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390281.240914:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879308416:12345-0@lo:400:kworker.0 Request processed in 33us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390281.240920:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390281.240931:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1785390281.240935:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872116879308544:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1785390281.240953:0:14933:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1785390281.241840:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390281.255207:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308672 00000100:00100000:3.0:1785390281.255280:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308672 00000100:00100000:3.0:1785390281.255350:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308800 00000100:00100000:3.0:1785390281.255353:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308800 00000100:00100000:3.0:1785390281.255383:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785390281.255393:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879308672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390281.257360:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879308672:12345-0@lo:400:kworker.0 Request processed in 1960us (16835us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390281.257374:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785390281.257410:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785390281.257421:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879308800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390281.258461:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1872116879308800:12345-0@lo:400:kworker.0 Request processed in 49us (16861us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390281.258556:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785390281.259422:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879308928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390281.259506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390281.259575:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879308928 00000100:00100000:1.0:1785390281.259586:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879308928 00000100:00100000:1.0:1785390281.259634:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390281.259643:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879308928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390281.259683:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390281.259737:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879308928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390281.259744:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1785390281.259786:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1785390281.259814:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879308928:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1785390281.260183:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fc87b80 x1872116879308800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390281.260211:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1872116879308800:0@lo:400:kworker.0 00000100:00080000:1.0:1785390281.260892:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785390281.260899:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390281.260930:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879308416:0@lo:400:kworker.0 00010000:00080000:3.0:1785390281.261032:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fc86680 x1872116879308672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390281.261043:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879308672:0@lo:400:kworker.0 00000100:00100000:1.0:1785390281.261095:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879308288:0@lo:400:kworker.0 00000100:00100000:3.0:1785390281.282183:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872116879308544:12345-0@lo:8:kworker.0 Request processed in 41232us (41724us total) trans 0 rc -19/-19 00000100:00100000:3.0:1785390281.282213:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1785390281.282215:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785390281.282226:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1785390281.282231:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879308544:0@lo:8:kworker.0 00010000:00010000:2.0:1785390281.373769:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785390282.212076:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1785390282.391064:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390283.415167:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390284.437818:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390285.461708:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1785390286.360285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1785390286.360294:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1785390286.360299:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1785390286.360324:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 589 00000100:00080000:1.0:1785390286.360330:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1785390286.360339:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:1.0:1785390286.360368:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf53fee7800 x1872116879309312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1785390286.360476:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879309056:0@lo:400:kworker.0 00000100:00100000:1.0:1785390286.360589:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390286.360647:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879309696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390286.360787:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390286.360816:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785390286.360822:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879309568:0@lo:400:kworker.0 00000100:00100000:1.0:1785390286.360854:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390286.361281:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879309440:0@lo:400:kworker.0 00000100:00100000:1.0:1785390286.361313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390286.361337:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390286.361343:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879309184:0@lo:400:kworker.0 00000100:00100000:1.0:1785390286.361367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390286.364399:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309568 00000100:00100000:3.0:1785390286.364418:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309568 00000100:00100000:3.0:1785390286.364505:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309440 00000100:00100000:3.0:1785390286.364508:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309440 00000100:00100000:3.0:1785390286.364546:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785390286.364558:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879309568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390286.364679:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879309568:12345-0@lo:400:kworker.0 Request processed in 123us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390286.364688:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785390286.364707:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785390286.364713:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879309440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390286.364744:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879309440:12345-0@lo:400:kworker.0 Request processed in 32us (3430us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390286.364750:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1785390286.364799:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785390286.365150:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fee4700 x1872116879309568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390286.365192:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879309568:0@lo:400:kworker.0 00000100:00100000:0.0:1785390286.365752:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309696 00000100:00100000:0.0:1785390286.365759:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309696 00000100:00100000:0.0:1785390286.365810:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785390286.365820:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879309696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1785390286.365862:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1785390286.365916:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879309696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390286.365923:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1785390286.365949:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309056 00000100:00100000:0.0:1785390286.365953:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309056 00000100:00100000:0.0:1785390286.365983:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785390286.365989:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3310:x1872116879309056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390286.366025:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3310:x1872116879309056:12345-0@lo:400:kworker.0 Request processed in 36us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390286.366032:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1785390286.366070:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879309312:0@lo:8:kworker.0 00000100:00100000:0.0:1785390286.366114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390286.366164:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309184 00000100:00100000:0.0:1785390286.366169:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309184 00000100:00100000:0.0:1785390286.366192:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309312 00000100:00100000:0.0:1785390286.366195:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309312 00000100:00100000:0.0:1785390286.366207:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390286.366214:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879309184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390286.366248:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879309184:12345-0@lo:400:kworker.0 Request processed in 35us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390286.366254:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390286.366269:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1785390286.366272:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879309312:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1785390286.366291:0:14931:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1785390286.368326:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390286.370153:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879309056:0@lo:400:kworker.0 00000100:00100000:3.0:1785390286.370194:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879309696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390286.374597:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879309184:0@lo:400:kworker.0 00010000:00080000:1.0:1785390286.376753:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf53fee6a00 x1872116879309440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1785390286.376772:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879309440:0@lo:400:kworker.0 00000100:00100000:0.0:1785390286.394879:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879309312:12345-0@lo:8:kworker.0 Request processed in 28573us (28733us total) trans 0 rc -19/-19 00000100:00100000:0.0:1785390286.394898:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1785390286.394915:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785390286.394925:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1785390286.394932:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879309312:0@lo:8:kworker.0 00010000:00010000:0.0:1785390286.485731:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390287.510696:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1785390288.523302:0:15601:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1785390288.523308:0:15601:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1785390288.523485:0:15601:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8cf51f0e5800 00000020:01000004:2.0:1785390288.523507:0:15601:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1785390288.523641:0:15601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1785390288.523661:0:15601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cf536a33380) 00000020:00000080:2.0:1785390288.523682:0:15601:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1785390288.537854:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1785390288.555236:0:15601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1785390288.555800:0:15601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1785390288.557776:0:15601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1785390288.558788:0:15601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1785390288.559932:0:15601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1785390288.560827:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 283: rc = 0 00100000:10000000:3.0:1785390288.561156:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 283: rc = 0 00100000:10000000:3.0:1785390288.561361:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 283: rc = 0 00100000:10000000:3.0:1785390288.562455:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 511: rc = 0 00100000:10000000:3.0:1785390288.563493:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 511: rc = 0 00100000:10000000:3.0:1785390288.565049:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 511: rc = 0 00100000:10000000:3.0:1785390288.565320:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 511: rc = 0 00100000:10000000:3.0:1785390288.565787:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 511: rc = 0 00100000:10000000:3.0:1785390288.566166:0:15601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 511: rc = 0 00000020:00000080:3.0:1785390288.567003:0:15601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1785390288.567069:0:15601:0:(osd_handler.c:1572:osd_obd_connect()) connect #0 00000020:00000080:3.0:1785390288.567083:0:15601:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33dffe75ff5edee0 00000020:01000004:3.0:1785390288.567093:0:15601:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1785390288.567120:0:15601:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1785390288.567124:0:15601:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1785390288.567132:0:15601:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1785390288.567159:0:15601:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1785390288.567165:0:15601:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1785390288.578494:0:15601:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1785390288.578722:0:15601:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.154@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1785390288.578733:0:15601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1785390288.578735:0:15601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785390288.578736:0:15601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785390288.578737:0:15601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785390288.578738:0:15601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785390288.578740:0:15601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785390288.578741:0:15601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785390288.578744:0:15601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785390288.578745:0:15601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785390288.578749:0:15601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1785390288.578751:0:15601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1785390288.578753:0:15601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1785390288.578754:0:15601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1785390288.578755:0:15601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1785390288.578756:0:15601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1785390288.578757:0:15601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1785390288.578758:0:15601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1785390288.578759:0:15601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1785390288.578760:0:15601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1785390288.578807:0:15601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1785390288.578832:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879309824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1785390288.580155:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.580239:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309824 00000100:00100000:2.0:1785390288.580246:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf51f0c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1785390288.580249:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309824 00000100:00100000:1.0:1785390288.580314:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785390288.580325:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:15601:x1872116879309824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1785390288.580378:0:14290:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1785390288.580381:0:14290:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1785390288.580386:0:14290:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1785390288.590273:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:15601:x1872116879309824:12345-0@lo:253:mount.lustre.0 Request processed in 9935us (10117us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.590293:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1785390288.590417:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879309824:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1785390288.590438:0:15601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1785390288.590442:0:15601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1785390288.590444:0:15601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1785390288.590446:0:15601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1785390288.590447:0:15601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1785390288.590449:0:15601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1785390288.590450:0:15601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1785390288.590452:0:15601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1785390288.590454:0:15601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1785390288.590455:0:15601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1785390288.590481:0:15601:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf51f0e5800 from lustre-OST0001 10000000:01000000:1.0:1785390288.590512:0:15601:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1785390288.590515:0:15601:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1785390288.590544:0:15601:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf53fea4d40 local copy 00010000:00010000:1.0:1785390288.590557:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390288.590970:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879309952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390288.591228:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.591318:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510acd540 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.591372:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879309952 00000100:00100000:2.0:1785390288.591381:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879309952 00000100:00100000:2.0:1785390288.592334:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1785390288.592349:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:15601:x1872116879309952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390288.592757:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:15601:x1872116879309952:12345-0@lo:501:mount.lustre.0 Request processed in 412us (1741us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785390288.592766:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1785390288.592861:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879309952:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1785390288.592882:0:15601:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1785390288.593061:0:15601:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1785390288.593071:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.593095:0:15601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4200/0x33dffe75ff5edc86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edc8d expref: -99 pid: 14277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390288.593128:0:15601:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf51f0e5800 10000000:01000000:1.0:1785390288.593132:0:15601:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1785390288.593138:0:15601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1785390288.593140:0:15601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785390288.593145:0:15601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1785390288.593148:0:15601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1785390288.593180:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.593190:0:15601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.593200:0:15601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390288.593217:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390288.593246:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.593838:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510acd540 going to sleep for 11 seconds 00000100:00100000:0.0:1785390288.593908:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310080 00000100:00100000:0.0:1785390288.593915:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310080 00000100:00100000:0.0:1785390288.593951:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1785390288.593958:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:15601:x1872116879310080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1785390288.593971:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390288.593986:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716c00/0x33dffe75ff5edeee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edee7 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.594014:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716c00/0x33dffe75ff5edeee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edee7 expref: 17 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.594127:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716c00/0x33dffe75ff5edeee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edee7 expref: 17 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.594137:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716c00, rc 0) 00000100:00100000:0.0:1785390288.594224:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310080:12345-0@lo:101:mount.lustre.0 Request processed in 266us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390288.594232:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1785390288.594383:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390288.594398:0:15601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edeee expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.594417:0:15601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edeee expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390288.595760:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1785390288.596985:0:15601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785390288.597321:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1785390288.597369:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1785390288.597415:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1785390288.597464:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1785390288.597502:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1785390288.597567:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1785390288.598163:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1785390288.598172:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1785390288.598273:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390288.598347:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.598393:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510acdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.598540:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310208 00000100:00100000:2.0:1785390288.598550:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310208 00000100:00100000:2.0:1785390288.598610:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1785390288.598620:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390288.599101:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310208:12345-0@lo:501:mount.lustre.0 Request processed in 483us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.599110:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1785390288.599567:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390288.599617:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390288.599778:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.599808:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510acdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.599857:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310336 00000100:00100000:2.0:1785390288.599862:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310336 00000100:00100000:2.0:1785390288.599925:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1785390288.599933:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310336:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390288.600254:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310336:12345-0@lo:503:mount.lustre.0 Request processed in 321us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.600262:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1785390288.600319:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310336:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785390288.601285:0:15601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785390288.601365:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390288.601421:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.602368:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510acdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1785390288.602455:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310464 00000100:00100000:0.0:1785390288.602464:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310464 00000100:00100000:0.0:1785390288.602502:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1785390288.602511:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785390288.602947:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310464:12345-0@lo:502:mount.lustre.0 Request processed in 437us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390288.602961:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1785390288.603052:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785390288.603430:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1785390288.603480:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1785390288.603559:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1785390288.603800:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1785390288.603844:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1785390288.603882:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1785390288.603931:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1785390288.603967:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1785390288.604029:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1785390288.604158:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390288.604213:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.604250:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510acdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.604307:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310592 00000100:00100000:2.0:1785390288.604315:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310592 00000100:00100000:2.0:1785390288.604348:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1785390288.604357:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785390288.604552:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310592:12345-0@lo:502:mount.lustre.0 Request processed in 194us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.604559:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1785390288.604825:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785390288.604889:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1785390288.604899:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1785390288.607902:0:15602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1785390288.607916:0:15602:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1785390288.607926:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390288.607928:0:15602:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1785390288.607934:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1785390288.607954:0:15602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cf50ddf8000) 00000020:00000080:1.0:1785390288.607986:0:15602:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1785390288.607992:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1785390288.608104:0:15602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf51f0e5800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1785390288.608118:0:15602:0:(osd_handler.c:1572:osd_obd_connect()) connect #1 00000020:00000080:1.0:1785390288.608128:0:15602:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33dffe75ff5edefc 00010000:00010000:1.0:1785390288.613082:0:15602:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1785390288.613778:0:15602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1785390288.616135:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1785390288.617778:0:15602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1785390288.617793:0:15602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785390288.617800:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390288.617813:0:15602:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1785390288.617818:0:15602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785390288.617823:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390288.617824:0:15602:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1785390288.617827:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1785390288.617830:0:15602:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1785390288.617832:0:15602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785390288.617834:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390288.617835:0:15602:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1785390288.617837:0:15602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1785390288.617839:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390288.617841:0:15602:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1785390288.617844:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1785390288.617901:0:15602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1785390288.617906:0:15602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1785390288.617907:0:15602:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1785390288.617911:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1785390288.619685:0:15601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1785390288.619719:0:15601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1785390288.619739:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edeee expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.619754:0:15601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f4e00/0x33dffe75ff5edee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edeee expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785390288.619764:0:15601:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf51f0e5800 from 1 10000000:01000000:0.0:1785390288.619767:0:15601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785390288.619813:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.619822:0:15601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.619834:0:15601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390288.619860:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1785390288.619941:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390288.619998:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf536a40480 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.620554:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310720 00000100:00100000:2.0:1785390288.620564:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310720 00000100:00100000:2.0:1785390288.620725:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1785390288.620738:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:15601:x1872116879310720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785390288.620755:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390288.620772:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edf03 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390288.620803:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390288.620828:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390288.620838:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c200, rc 0) 00000100:00100000:2.0:1785390288.621745:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879310720:12345-0@lo:101:mount.lustre.0 Request processed in 1008us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.621754:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1785390288.624791:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1785390288.624824:0:15601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.624838:0:15601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785390288.630470:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1785390288.631962:0:15601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785390288.632458:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1785390288.632519:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1785390288.632634:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1785390288.632643:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1785390288.632894:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390288.632978:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.633153:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310848 00000100:00100000:1.0:1785390288.633163:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310848 00000100:00100000:1.0:1785390288.633222:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1785390288.633235:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879310848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390288.633485:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879310848:12345-0@lo:501:mount.lustre.0 Request processed in 252us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390288.633494:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1785390288.633746:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508e9ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.633773:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1785390288.633817:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1785390288.633856:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390288.633907:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508e9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1785390288.634916:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879310976 00000100:00100000:1.0:1785390288.634921:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879310976 00000100:00100000:1.0:1785390288.634990:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1785390288.634998:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879310976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390288.635317:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879310976:12345-0@lo:503:mount.lustre.0 Request processed in 319us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390288.635325:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1785390288.635395:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879310976:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1785390288.635937:0:15601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1785390288.636004:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785390288.636061:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390288.636827:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf536a40f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.636926:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311104 00000100:00100000:2.0:1785390288.636932:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311104 00000100:00100000:2.0:1785390288.636962:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1785390288.636969:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879311104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785390288.637177:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879311104:12345-0@lo:502:mount.lustre.0 Request processed in 207us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.637195:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1785390288.637284:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785390288.637517:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1785390288.637582:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1785390288.637643:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1785390288.637793:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1785390288.637832:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1785390288.637882:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1785390288.637919:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1785390288.637957:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1785390288.637988:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1785390288.638030:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390288.638054:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf536a40f00 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.638109:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311232 00000100:00100000:2.0:1785390288.638114:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311232 00000100:00100000:2.0:1785390288.638135:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1785390288.638141:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879311232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1785390288.638269:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879311232:12345-0@lo:502:mount.lustre.0 Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.638275:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1785390288.638414:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1785390288.638480:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1785390288.638489:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1785390288.639409:0:15606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785390288.639421:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390288.639424:0:15606:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1785390288.639432:0:15606:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf51f0e5800 00000020:00000080:2.0:1785390288.639435:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785390288.639443:0:15606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785390288.639446:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390288.639447:0:15606:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1785390288.639450:0:15606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785390288.639452:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390288.639453:0:15606:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1785390288.639457:0:15606:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf51f0e5800 00000020:00000080:2.0:1785390288.639459:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785390288.639550:0:15606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785390288.639554:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390288.639556:0:15606:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1785390288.639558:0:15606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1785390288.639561:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390288.639563:0:15606:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1785390288.639566:0:15606:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf51f0e5800 00000020:00000080:2.0:1785390288.639569:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1785390288.639617:0:15606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1785390288.639628:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1785390288.639630:0:15606:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1785390288.639633:0:15606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1785390288.639887:0:15601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1785390288.639913:0:15601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1785390288.639940:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.639954:0:15601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1785390288.640010:0:15601:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1785390288.640014:0:15601:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf51f0e5800 10000000:01000000:1.0:1785390288.640018:0:15601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf51f0e5800 10000000:01000000:1.0:1785390288.640022:0:15601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1785390288.640029:0:15601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8cf51f0e5800 from 1 10000000:01000000:1.0:1785390288.640032:0:15601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1785390288.640066:0:15601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.640076:0:15601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.640086:0:15601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390288.640103:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1785390288.640147:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.640174:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf402941480 going to sleep for 11 seconds 00000100:00100000:2.0:1785390288.640226:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311360 00000100:00100000:2.0:1785390288.640232:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311360 00000100:00100000:2.0:1785390288.640267:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1785390288.640275:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879311360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1785390288.640285:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390288.640299:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121d800/0x33dffe75ff5edf18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edf11 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390288.640323:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121d800/0x33dffe75ff5edf18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edf11 expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390288.640335:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121d800/0x33dffe75ff5edf18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edf11 expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390288.640346:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d800, rc 0) 00000100:00100000:2.0:1785390288.640378:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311360:12345-0@lo:101:mount.lustre.0 Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390288.640384:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1785390288.640468:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1785390288.640481:0:15601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf18 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390288.640502:0:15601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edf18 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390288.642950:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1785390288.646715:0:15601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1785390288.647049:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1785390288.647097:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1785390288.647134:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1785390288.647184:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1785390288.647221:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1785390288.647270:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1785390288.647306:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1785390288.647343:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1785390288.647392:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1785390288.647443:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1785390288.647478:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1785390288.647541:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1785390288.647578:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1785390288.647611:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1785390288.647686:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1785390288.647726:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1785390288.647775:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1785390288.647823:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1785390288.647856:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1785390288.647889:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1785390288.647940:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1785390288.647977:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1785390288.648013:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1785390288.648065:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1785390288.648105:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1785390288.648141:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1785390288.648204:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1785390288.648243:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1785390288.648275:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1785390288.648323:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1785390288.648359:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1785390288.648392:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1785390288.650970:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1785390288.651050:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1785390288.651086:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1785390288.651139:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1785390288.651179:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1785390288.651287:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1785390288.651296:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1785390288.651440:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390288.651547:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.655707:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf402941480 going to sleep for 11 seconds 00000100:00100000:0.0:1785390288.656497:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311488 00000100:00100000:0.0:1785390288.656510:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311488 00000100:00100000:0.0:1785390288.656601:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1785390288.656613:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1785390288.657006:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311488:12345-0@lo:501:mount.lustre.0 Request processed in 394us (5480us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390288.657016:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1785390288.659921:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1785390288.660001:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1785390288.660083:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.660139:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf402941480 going to sleep for 11 seconds 00000100:00100000:3.0:1785390288.660231:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311616 00000100:00100000:3.0:1785390288.660238:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311616 00000100:00100000:3.0:1785390288.660299:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1785390288.660310:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1785390288.660832:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311616:12345-0@lo:503:mount.lustre.0 Request processed in 522us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.660846:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1785390288.661469:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1785390288.662178:0:15601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1785390288.662264:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390288.662323:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.662358:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf402941480 going to sleep for 11 seconds 00000100:00100000:3.0:1785390288.663576:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311744 00000100:00100000:3.0:1785390288.663587:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311744 00000100:00100000:3.0:1785390288.663740:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1785390288.663749:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1785390288.664091:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311744:12345-0@lo:502:mount.lustre.0 Request processed in 342us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.664098:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1785390288.664238:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785390288.664567:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1785390288.665768:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1785390288.665809:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1785390288.665856:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1785390288.665890:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1785390288.665942:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1785390288.665979:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1785390288.666033:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1785390288.666095:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1785390288.666135:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1785390288.666170:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1785390288.666221:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1785390288.666253:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1785390288.666283:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1785390288.666332:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1785390288.666363:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1785390288.666388:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1785390288.666446:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1785390288.666476:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1785390288.666503:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1785390288.666578:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1785390288.669868:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1785390288.669931:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1785390288.670035:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1785390288.670077:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1785390288.670115:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1785390288.670168:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1785390288.670206:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1785390288.670243:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1785390288.670304:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1785390288.670344:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1785390288.670380:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1785390288.672759:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1785390288.672863:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1785390288.672912:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1785390288.672966:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1785390288.673005:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1785390288.673042:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1785390288.673099:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1785390288.673162:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1785390288.673227:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390288.673332:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390288.673408:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879311872 00000100:00100000:1.0:1785390288.673418:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879311872 00000100:00100000:1.0:1785390288.673486:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785390288.673497:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf508fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1785390288.675977:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf508fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879311872:12345-0@lo:502:mount.lustre.0 Request processed in 2474us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390288.675991:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1785390288.676071:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf402941480 going to sleep for 11 seconds 00000100:00100000:1.0:1785390288.676103:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879311872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1785390288.676220:0:15601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1785390288.676236:0:15601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1785390288.687361:0:15611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1785390288.687385:0:15611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cf53f424d40) 00000020:00000080:3.0:1785390288.687426:0:15611:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1785390288.692892:0:15611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf51f0e5800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1785390288.692907:0:15611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf51f0e5800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1785390288.692911:0:15611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf51f0e5800 3 00010000:00080000:3.0:1785390288.692973:0:15611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf4012d7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.154@tcp at head 00010000:00010000:3.0:1785390288.697205:0:15611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1785390288.697342:0:15611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1785390288.697394:0:15611:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1785390288.697420:0:15611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x33dffe75ff5edf26 00000100:00080000:3.0:1785390288.697434:0:15611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1785390288.697441:0:15611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf4012d7800 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785390288.697492:0:15611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402231f80 x1872116879312000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1785390288.697545:0:15611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1785390288.697723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785390288.697727:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785390288.697737:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785390288.697742:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:3.0:1785390288.697745:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1785390288.697750:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785390288.697777:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402231500 x1872116879312256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785390288.697831:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879312128:0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.697913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390288.697954:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1785390288.697959:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879312384:0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.698005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390288.698201:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879312512:0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.698229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390288.698270:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312128 00000100:00100000:3.0:1785390288.698278:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312128 00000100:00100000:3.0:1785390288.698336:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785390288.698347:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879312128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.698420:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879312128:12345-0@lo:400:kworker.0 Request processed in 74us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.698429:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1785390288.698453:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312384 00000100:00100000:3.0:1785390288.698457:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312384 00000100:00100000:3.0:1785390288.698480:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312512 00000100:00100000:3.0:1785390288.698482:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312512 00000100:00100000:3.0:1785390288.698496:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785390288.698502:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879312384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.698551:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1872116879312384:12345-0@lo:400:kworker.0 Request processed in 49us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.698563:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785390288.698574:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1785390288.698579:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879312512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.698623:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879312512:12345-0@lo:400:kworker.0 Request processed in 42us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.698629:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1785390288.699357:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785390288.699364:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1785390288.699413:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf402230a80 x1872116879312384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390288.699427:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1872116879312384:0@lo:400:kworker.0 00000100:00100000:3.0:1785390288.699444:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879312128:0@lo:400:kworker.0 00010000:00080000:3.0:1785390288.699477:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf402232a00 x1872116879312512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390288.699486:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879312512:0@lo:400:kworker.0 00000100:00100000:2.0:1785390288.701509:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872116879312000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1785390288.701748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390288.701833:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879312256:0@lo:8:kworker.0 00000100:00100000:2.0:1785390288.701862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390288.701902:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312256 00000100:00100000:2.0:1785390288.701909:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312256 00000100:00100000:2.0:1785390288.701942:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785390288.701948:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879312256:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1785390288.702020:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1872116879312256:12345-0@lo:8:kworker.0 Request processed in 69us (156us total) trans 0 rc -11/-11 00000100:00100000:2.0:1785390288.702027:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785390288.702064:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785390288.702072:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1785390288.702076:0:3306:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1785390288.702079:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879312256:0@lo:8:kworker.0 00000100:00100000:0.0:1785390288.702128:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312000 00000100:00100000:0.0:1785390288.702133:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312000 00000100:00100000:0.0:1785390288.702166:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1785390288.702172:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1872116879312000:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1785390288.702190:0:14296:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:0.0:1785390288.702241:0:14296:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x33dffe75ff5edf2d 00000004:00100000:0.0:1785390288.702261:0:14296:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1785390288.702296:0:14296:0:(import.c:65:import_set_state_nolock()) ffff8cf51f0e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1785390288.702347:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1872116879312000:12345-0@lo:38:llog_process_th.0 Request processed in 173us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390288.702355:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1785390288.702433:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf402231f80 x1872116879312000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1785390298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1785390288.702443:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1785390288.702449:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1785390288.702457:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1785390288.702463:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1785390288.702466:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf4012d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1785390288.702471:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1872116879312000:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1785390288.703075:0:15611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1785390288.703269:0:15601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1785390288.703301:0:15601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1785390288.703324:0:15601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf18 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390288.703336:0:15601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf5421f5000/0x33dffe75ff5edf11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf18 expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1785390288.703381:0:15601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1785390288.703384:0:15601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1785390288.703385:0:15601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785390288.703387:0:15601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785390288.703388:0:15601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785390288.703390:0:15601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785390288.703392:0:15601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785390288.703394:0:15601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785390288.703395:0:15601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1785390288.703434:0:15601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1785390288.703437:0:15601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1785390288.703439:0:15601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1785390288.703440:0:15601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785390288.703442:0:15601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785390288.703443:0:15601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785390288.703444:0:15601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785390288.703446:0:15601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785390288.703447:0:15601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785390288.703448:0:15601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1785390288.703470:0:15601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1785390288.703490:0:15601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879312640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1785390288.703553:0:15601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390288.703582:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312640 00000100:00100000:0.0:1785390288.703586:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312640 00000100:00100000:0.0:1785390288.703742:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785390288.703751:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:15601:x1872116879312640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1785390288.703787:0:14290:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1785390288.703802:0:14290:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1785390288.704311:0:15601:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf536a40a80 going to sleep for 11 seconds 20000000:01000000:3.0:1785390288.758101:0:14290:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1785390288.758119:0:14290:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1785390288.758142:0:14311:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1785390288.758148:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1785390288.758174:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758198:0:14311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 19 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758231:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758278:0:14311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 19 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758294:0:14311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 19 pid: 14289 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390288.758313:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14311:1872116879312768:0@lo:104: 00000100:00100000:3.0:1785390288.758393:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390288.758452:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803780 going to sleep for 11 seconds 00000100:00100000:3.0:1785390288.758479:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312768 00000100:00100000:3.0:1785390288.758488:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312768 00000100:00100000:3.0:1785390288.758551:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785390288.758560:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14311:x1872116879312768:12345-0@lo:104: 00010000:00010000:3.0:1785390288.758574:0:14278:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758637:0:14278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785390288.758643:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:14311:x1872116879312768:12345-0@lo:104: Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.758706:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1785390288.758732:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390288.758739:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758747:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4600 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390288.758758:0:14284:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758768:0:14284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390288.758777:0:14284:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390288.758783:0:14284:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1785390288.758812:0:14284:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758818:0:14284:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390288.758838:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758845:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf535ef4600/0x33dffe75ff5ede00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5ede07 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.758862:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390288.758863:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390288.758865:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390288.758883:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879312896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390288.758912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390288.758944:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879312896 00000100:00100000:3.0:1785390288.758948:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879312896 00010000:00010000:3.0:1785390288.758965:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 20 pid: 14289 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390288.758988:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785390288.759002:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+20:3310:x1872116879312896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390288.759014:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390288.759020:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 20 pid: 14289 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759031:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 20 pid: 14289 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759049:0:14280:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759057:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1785390288.759071:0:14280:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006939477s 00010000:00010000:3.0:1785390288.759075:0:14280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759082:0:14280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759090:0:14280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759097:0:14280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759103:0:14280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390288.759107:0:14280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759127:0:14280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759138:0:14280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759148:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390288.759180:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+20:3310:x1872116879312896:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.759187:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785390288.759226:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879312896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1785390288.759254:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4a00/0x33dffe75ff5ede07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5ede00 expref: 19 pid: 14289 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390288.759275:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14311:1872116879312768:0@lo:104: 00010000:00010000:3.0:1785390288.759285:0:14311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759295:0:14311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759301:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390288.759307:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4600/0x33dffe75ff5edf34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390288.780486:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:15601:x1872116879312640:12345-0@lo:253:mount.lustre.0 Request processed in 76722us (76917us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390288.780555:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1785390288.782613:0:15601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:374ce4d4-733e-4fe2-9421-711e41cbfd01:15601:1872116879312640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1785390288.782637:0:15601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1785390288.782641:0:15601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1785390288.782643:0:15601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1785390288.782644:0:15601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1785390288.782646:0:15601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1785390288.782700:0:15601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1785390288.782703:0:15601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1785390288.782704:0:15601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1785390288.782707:0:15601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1785390288.782708:0:15601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1785390288.782734:0:15601:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1785390288.790256:0:15601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1785390288.790458:0:15601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1785390288.790745:0:15601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1785390288.790995:0:15601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1785390288.791203:0:15601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1785390288.791445:0:15601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1785390288.793413:0:15601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1785390288.865068:0:15601:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1785390288.865081:0:15601:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1785390288.865129:0:15601:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1785390288.865203:0:15601:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1785390288.865223:0:15601:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1785390288.865258:0:15601:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1785390289.558831:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1785390290.454517:0:14292:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1785390290.454548:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8cf5356ae000 from 8 10000000:01000000:3.0:1785390290.454554:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1785390290.454608:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390290.454621:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390290.454635:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390290.454666:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879313024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1785390290.454857:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390290.454951:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390290.455086:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313024 00000100:00100000:1.0:1785390290.455095:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313024 00000100:00100000:1.0:1785390290.455146:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1785390290.455155:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879313024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390290.455172:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390290.455189:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4800/0x33dffe75ff5edf42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5edf3b expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390290.455217:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4800/0x33dffe75ff5edf42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5edf3b expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390290.455238:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4800/0x33dffe75ff5edf42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edf3b expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390290.455248:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4800, rc 0) 00000100:00100000:1.0:1785390290.455293:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879313024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390290.455301:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1785390290.455433:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879313024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390290.455450:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf42 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390290.455460:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5edf42 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390290.455521:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879313152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1785390290.455578:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390290.455600:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf508803cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1785390290.460329:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313152 00000100:00100000:1.0:1785390290.460348:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313152 00000100:00100000:1.0:1785390290.460432:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1785390290.460444:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879313152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1785390290.460478:0:14290:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1785390290.460498:0:14290:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1785390290.460501:0:14290:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1785390290.460687:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879313152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 245us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390290.460696:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1785390290.462795:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879313152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1785390290.464126:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1785390290.464141:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf42 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390290.464156:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4600/0x33dffe75ff5edf3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5edf42 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390290.583667:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390291.479916:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879313280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390291.480014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390291.480128:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313280 00000100:00100000:1.0:1785390291.480137:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313280 00000100:00100000:1.0:1785390291.480209:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1785390291.480219:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879313280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390291.480267:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390291.480318:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879313280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390291.480344:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1785390291.480370:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390291.480428:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879313280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390291.613888:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1785390292.438902:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1785390292.638403:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390293.662091:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1785390294.038027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1785390294.038035:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1785390294.038040:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1785390294.038056:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf502f01000 using connection 192.168.202.154@tcp/0@lo 00000100:00100000:3.0:1785390294.038092:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf402233800 x1872116879313664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1785390294.038281:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879313408:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.038383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390294.038450:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879314048:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.038500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390294.038543:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785390294.038560:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879313920:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.038584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390294.038612:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879313536:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.038637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390294.038653:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1785390294.038656:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879313792:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.038674:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390294.040363:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879313664:0@lo:8:kworker.0 00000100:00100000:3.0:1785390294.040420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390294.040428:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313408 00000100:00100000:1.0:1785390294.040439:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313408 00000100:00100000:3.0:1785390294.040463:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314048 00000100:00100000:3.0:1785390294.040468:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314048 00000100:00100000:1.0:1785390294.040509:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785390294.040512:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313920 00000100:00100000:3.0:1785390294.040516:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313920 00000100:00100000:1.0:1785390294.040540:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3308:x1872116879313408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.040555:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313792 00000100:00100000:3.0:1785390294.040559:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313792 00000100:00100000:3.0:1785390294.040571:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785390294.040577:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879314048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.040618:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879314048:12345-0@lo:400:kworker.0 Request processed in 40us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.040624:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785390294.040639:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785390294.040644:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879313920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.040666:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879313920:12345-0@lo:400:kworker.0 Request processed in 22us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.040671:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785390294.040679:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785390294.040684:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879313792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.040716:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879313792:12345-0@lo:400:kworker.0 Request processed in 32us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.040722:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785390294.040746:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313536 00000100:00100000:3.0:1785390294.040749:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313536 00000100:00100000:1.0:1785390294.040755:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3308:x1872116879313408:12345-0@lo:400:kworker.0 Request processed in 234us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390294.040764:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1785390294.040778:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879313664 00000100:00100000:3.0:1785390294.040781:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879313664 00000100:00100000:3.0:1785390294.040797:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1785390294.040804:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390294.040805:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879313536:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1785390294.040811:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390294.040843:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879313536:12345-0@lo:400:kworker.0 Request processed in 39us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.040849:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1785390294.040864:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1785390294.040869:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1872116879313664:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1785390294.040898:0:14933:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:3.0:1785390294.040934:0:14933:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33dffe75ff5edf49 00002000:00100000:3.0:1785390294.040951:0:14933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cf4012d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1785390294.040955:0:14933:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1785390294.040958:0:14933:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1785390294.043936:0:14933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1785390294.043976:0:14933:0:(import.c:65:import_set_state_nolock()) ffff8cf4012d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785390294.045196:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1872116879313664:12345-0@lo:8:kworker.0 Request processed in 3198us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.045212:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1785390294.045309:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf402233800 x1872116879313664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1785390319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1785390294.045362:0:3306:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1785390294.045376:0:3306:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1785390294.045382:0:3306:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1785390294.045384:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8cf502f01000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1785390294.045406:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1785390294.045412:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1872116879313664:0@lo:8:kworker.0 00000004:00080000:3.0:1785390294.045447:0:14319:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1785390294.045977:0:14320:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1785390294.046007:0:14320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14320:1872116879314304:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1785390294.046707:0:14320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390294.046742:0:14320:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53b78d180 going to sleep for 11 seconds 00000004:00080000:3.0:1785390294.048902:0:14319:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 602603375003ns, next at 0ns, rc = 0 00000100:00100000:3.0:1785390294.048943:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1785390294.048965:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879314176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390294.049035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390294.050543:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314176 00000100:00100000:3.0:1785390294.052220:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314176 00000100:00100000:3.0:1785390294.052310:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785390294.052323:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879314176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390294.052381:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390294.052474:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1872116879314176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.052481:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1785390294.054008:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1785390294.055618:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf402d0c700 x1872116879314176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1785390310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390294.055656:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879314176:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1785390294.057426:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf402231500 x1872116879313920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390294.057452:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879313920:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.057468:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879313408:0@lo:400:kworker.0 00010000:00080000:3.0:1785390294.057480:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf402233100 x1872116879314048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390294.057487:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879314048:0@lo:400:kworker.0 00000100:00100000:3.0:1785390294.057547:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314304 00000100:00100000:3.0:1785390294.057555:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314304 00000100:00100000:3.0:1785390294.057606:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1785390294.057615:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14320:x1872116879314304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1785390294.075272:0:14933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1785390294.075288:0:14933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1785390294.075295:0:14933:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:0.0:1785390294.077516:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf402231f80 x1872116879313792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1785390294.077556:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879313792:0@lo:400:kworker.0 00000100:00100000:0.0:1785390294.077603:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879313536:0@lo:400:kworker.0 00002000:00010000:3.0:1785390294.104268:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.104284:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104305:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.104310:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.104317:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104338:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104374:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104383:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104407:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390294.104422:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390294.104428:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104435:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390294.104440:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104450:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104472:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104479:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.104499:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.104506:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.104508:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.112647:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.112665:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.114200:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.114209:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.114220:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.114241:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.114254:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.114262:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.114288:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.114758:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.114768:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.114779:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4a00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.114784:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.114796:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.114822:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.114837:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000addfd32b/0x33dffe75ff5edf57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.114861:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.114863:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.114865:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.117796:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.117810:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117829:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.117835:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.117842:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117867:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117879:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117888:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117911:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390294.117927:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390294.117933:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117941:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390294.117945:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117956:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117972:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.117981:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.118005:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.118007:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.118009:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.122964:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.122980:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.123000:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.123005:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.123012:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.123028:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.123038:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.123048:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.124586:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390294.124607:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390294.124615:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.124638:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390294.124643:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.124653:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.124673:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.124679:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ec6a32c/0x33dffe75ff5edf65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.125178:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.125180:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.125182:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1785390294.128730:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1785390294.132004:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.132021:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.132042:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.132047:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.132053:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.132080:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.132100:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.134200:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.134250:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390294.134731:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390294.134742:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.134753:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390294.134765:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.134778:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.134802:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.134810:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008610fde8/0x33dffe75ff5edf6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.134832:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.134835:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.134837:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.136593:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.136605:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.136622:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.136627:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.136633:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.136646:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.136655:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.136663:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.137812:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.138399:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.138410:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.138424:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.138430:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.138451:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.138475:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.138484:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000925af618/0x33dffe75ff5edf73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.138509:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.138511:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.138521:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.142787:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.142807:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.142828:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.142834:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.142841:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.142857:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.142867:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.142875:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.142908:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.143402:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.143413:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143425:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.143430:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143440:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143474:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143482:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f12dee/0x33dffe75ff5edf7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143511:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.143513:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.143516:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.143546:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.143554:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.143564:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.143574:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.143579:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.143590:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.143599:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.143606:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.143630:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.143732:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.143738:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143747:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.143750:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143772:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143783:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143791:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794fd132/0x33dffe75ff5edf81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.143806:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.143807:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.143809:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.148728:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.148747:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.148768:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.148774:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.148781:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.148799:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.148812:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.148828:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.148853:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785390294.149444:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.149452:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149463:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.149466:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.149471:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149483:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149491:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149500:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149547:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1785390294.149687:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785390294.149697:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149708:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.149714:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149724:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149747:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149768:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a647cdc/0x33dffe75ff5edf88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149791:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.149795:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149801:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.149804:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149812:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149825:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149833:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244063db/0x33dffe75ff5edf8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.149850:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.149852:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.149855:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.149936:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.149941:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149954:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.149956:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.149960:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149968:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149975:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.149982:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.150000:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390294.150297:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390294.150306:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.150314:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390294.150318:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.150326:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.150343:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.150361:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edf96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.150379:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.150381:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.150382:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.150416:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.153271:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.153286:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.153303:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.153309:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.153316:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.153332:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.153365:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.153374:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.153440:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785390294.154018:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.154024:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.154033:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.154037:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.154041:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.154050:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.154058:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.154067:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.161517:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785390294.161551:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.161585:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.161590:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.161603:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.161628:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.161636:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edf9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.161724:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390294.161732:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.161742:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390294.161754:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.161763:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.161767:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1785390294.161779:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.161788:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edfa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.161806:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.161809:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.161811:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.162146:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.165064:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.165358:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.165379:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.165384:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.165392:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.165409:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.165421:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.165429:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.165509:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1785390294.169984:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.170000:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.170019:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.170030:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.170037:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.170053:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.170062:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.171233:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175541:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1785390294.175561:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175579:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.175585:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175598:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175639:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175647:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa3875e/0x33dffe75ff5edfab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175861:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.175866:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175874:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.175877:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175885:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175896:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.175904:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.175907:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.175909:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.176046:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1785390294.176055:0:14933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5edfb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.176574:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.180406:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.180424:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.180445:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.180451:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.180459:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.180550:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.180573:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.180582:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.180606:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.181656:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.181667:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.181686:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.181691:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.181703:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.181724:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.181731:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d25e903/0x33dffe75ff5edfb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.181758:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.181760:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.181762:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.182710:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.182720:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.182732:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.182737:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.182743:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.182756:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.182765:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.182774:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.182808:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.184216:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.184225:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.184235:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.184239:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.184249:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.184285:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.184294:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011519e8a/0x33dffe75ff5edfc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.184314:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.184316:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.184317:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.184788:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.184796:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.184806:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.184811:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.184817:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.184828:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.184837:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.184844:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.185581:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.192917:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.192937:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.192955:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5c00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.192960:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.192979:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.193007:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.193015:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6c6ada8/0x33dffe75ff5edfc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.193381:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.193385:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.193388:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785390294.199251:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390294.199268:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.199292:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1785390294.199298:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390294.199306:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.199323:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.199344:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.199387:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.199415:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.199742:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.199751:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.199760:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d600 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.199766:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.199775:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.199796:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.199804:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beed315f/0x33dffe75ff5edfce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.199823:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.199825:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.199827:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785390294.201379:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390294.201389:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.201402:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1785390294.201406:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390294.201411:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.201423:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.201431:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.201440:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.203975:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1785390294.206272:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390294.206288:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.206307:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1785390294.206312:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390294.206320:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.206336:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.206347:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.206373:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.206397:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1785390294.207677:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1785390294.207688:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207699:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121cc00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390294.207705:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207717:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207740:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207755:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c991262c/0x33dffe75ff5edfd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207775:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390294.207778:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207785:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121ce00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390294.207788:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207797:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207806:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207812:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dffee72/0x33dffe75ff5edfdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.207823:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.207825:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.207827:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.208574:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785390294.218203:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390294.218223:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.218247:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1785390294.218261:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390294.218269:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.218286:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.218298:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.218306:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.218343:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1785390294.218402:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390294.218412:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.218423:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390294.218440:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.218453:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.218489:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.218498:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e01e7d0/0x33dffe75ff5edfe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390294.218553:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.218556:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390294.218558:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1785390294.220194:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390294.220203:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.220219:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1785390294.220224:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1785390294.220229:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.220243:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.220253:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.220268:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.220296:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1785390294.220389:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390294.220398:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.220408:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:3.0:1785390294.220421:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.220432:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.220449:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.220458:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f8854e/0x33dffe75ff5edfea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.220490:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.220492:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.220494:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.223981:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.223995:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224015:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.224020:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.224027:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224042:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224054:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224069:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224096:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390294.224564:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1785390294.224614:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.224619:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224628:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.224631:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.224635:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224645:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224653:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224662:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.224679:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1785390294.224791:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224812:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4800 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390294.224818:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224829:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224850:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224857:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaf9791d/0x33dffe75ff5edff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224881:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1785390294.224885:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224892:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390294.224896:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224904:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224915:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224931:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5edff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390294.224950:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.224952:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390294.224954:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.225040:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1785390294.225042:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390294.225047:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225061:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.225064:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.225069:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225078:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225087:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225095:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225116:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390294.225138:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390294.225146:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225154:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390294.225158:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225166:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225180:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225187:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0943266/0x33dffe75ff5edfff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225206:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.225210:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.225212:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1785390294.225574:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1785390294.225580:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225589:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1785390294.225592:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390294.225597:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225607:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225625:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225632:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390294.225651:0:14933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1785390294.225724:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1785390294.225738:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225746:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5400 already unused, calling callback (ffffffffc1599300) 00010000:00010000:2.0:1785390294.225750:0:14283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225760:0:14283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225772:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225780:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037b052e5/0x33dffe75ff5ee006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390294.225797:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.225800:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390294.225803:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1785390294.225819:0:14933:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1785390294.225943:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14320:x1872116879314304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 168324us (179233us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390294.225953:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785390294.226425:0:14320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14320:1872116879314304:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1785390294.226503:0:14320:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1785390294.226705:0:14320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402d0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14320:1872116879314432:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1785390294.226755:0:14320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390294.226808:0:14320:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53b78d180 going to sleep for 11 seconds 00000100:00100000:2.0:1785390294.226918:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314432 00000100:00100000:2.0:1785390294.226927:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314432 00000100:00100000:2.0:1785390294.226980:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1785390294.226991:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14320:x1872116879314432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1785390294.227041:0:14934:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1785390294.243126:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14320:x1872116879314432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16122us (16357us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1785390294.243145:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1785390294.243397:0:14320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402d0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14320:1872116879314432:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1785390294.243418:0:14320:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1785390294.677878:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390295.704345:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390296.600750:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879314560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1785390296.600847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390296.604867:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314560 00000100:00100000:1.0:1785390296.604889:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314560 00000100:00100000:1.0:1785390296.604988:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785390296.605001:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879314560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390296.605065:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390296.605176:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879314560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (4328us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390296.605185:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1785390296.605226:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390296.605284:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879314560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1785390296.735985:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390297.750316:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1785390298.054019:0:15957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1785390298.773763:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390299.157802:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879314688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390299.157899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390299.158007:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314688 00000100:00100000:3.0:1785390299.158016:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314688 00000100:00100000:3.0:1785390299.158518:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785390299.158566:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879314688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390299.158615:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390299.158673:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1872116879314688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390299.158698:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1785390299.158724:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1785390299.158771:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879314688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390299.159016:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1785390299.159029:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879314944:0@lo:400:kworker.0 00000100:00100000:1.0:1785390299.159078:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390299.159125:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879315072:0@lo:400:kworker.0 00000100:00100000:1.0:1785390299.159155:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390299.160570:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314944 00000100:00100000:3.0:1785390299.160581:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314944 00000100:00100000:3.0:1785390299.160633:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785390299.160642:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879314944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.160705:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879314944:12345-0@lo:400:kworker.0 Request processed in 65us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390299.160713:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785390299.160736:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315072 00000100:00100000:3.0:1785390299.160740:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315072 00000100:00100000:3.0:1785390299.160770:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785390299.160777:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879315072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.160812:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1872116879315072:12345-0@lo:400:kworker.0 Request processed in 36us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390299.160819:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1785390299.160850:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879314816:0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.160888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390299.160921:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879315328:0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.160959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390299.160981:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785390299.160987:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879315200:0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.161010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390299.161051:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879314816 00000100:00100000:3.0:1785390299.161735:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879314816 00000100:00100000:3.0:1785390299.161766:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1785390299.161774:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3308:x1872116879314816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.161816:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3308:x1872116879314816:12345-0@lo:400:kworker.0 Request processed in 44us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390299.161823:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1785390299.161869:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390299.161880:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315328 00000100:00100000:3.0:1785390299.161883:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315328 00000100:00100000:3.0:1785390299.161909:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315200 00000100:00100000:3.0:1785390299.161912:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315200 00000100:00100000:3.0:1785390299.161940:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785390299.161946:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879315328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.161978:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879315328:12345-0@lo:400:kworker.0 Request processed in 32us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390299.161984:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1785390299.161997:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1785390299.162002:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879315200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.162171:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879315200:12345-0@lo:400:kworker.0 Request processed in 168us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390299.162178:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1785390299.162197:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1785390299.162231:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fee7480 x1872116879315072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390299.162246:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1872116879315072:0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.162261:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879314944:0@lo:400:kworker.0 00010000:00080000:3.0:1785390299.162321:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fee7800 x1872116879315200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390299.162331:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879315200:0@lo:400:kworker.0 00000100:00100000:3.0:1785390299.162342:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879314816:0@lo:400:kworker.0 00010000:00080000:3.0:1785390299.162351:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf53fee4e00 x1872116879315328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1785390315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1785390299.162360:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879315328:0@lo:400:kworker.0 00000001:00080000:1.0:1785390299.291192:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1785390299.291266:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1785390299.797767:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390300.821905:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390301.717955:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879315456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390301.718068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390301.718221:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315456 00000100:00100000:1.0:1785390301.718232:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315456 00000100:00100000:1.0:1785390301.718322:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785390301.718334:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879315456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390301.718380:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390301.718450:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879315456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390301.718458:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785390301.718550:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879315456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785390301.718892:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785390301.846350:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390301.910596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390301.910714:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847850496 00000100:00100000:1.0:1785390301.910725:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847850496 00000100:00100000:1.0:1785390301.910773:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:1.0:1785390301.910780:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2356:x1872116847850496:12345-192.168.202.54@tcp:250:mount.lustre.0 00010000:00080000:1.0:1785390301.910812:0:14290:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b535d1a6-eb8a-4566-b7f2-17b4078f4969@192.168.202.54@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:1.0:1785390301.910850:0:14290:0:(genops.c:1406:class_connect()) connect: client b535d1a6-eb8a-4566-b7f2-17b4078f4969, cookie 0x33dffe75ff5ee00d 00000100:00080000:1.0:1785390301.911115:0:14290:0:(import.c:65:import_set_state_nolock()) ffff8cf535a53000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785390301.911212:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+5:2356:x1872116847850496:12345-192.168.202.54@tcp:250:mount.lustre.0 Request processed in 431us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390301.911218:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 76 00000100:00100000:2.0:1785390301.927855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390301.928436:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847850624 00000100:00100000:1.0:1785390301.928449:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847850624 00000100:00100000:1.0:1785390301.928564:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:1.0:1785390301.928896:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+5:13731:x1872116847850624:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785390301.928926:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390301.928950:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ee014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c30d expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390301.928985:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ee014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c30d expref: 6 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390301.929149:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4600/0x33dffe75ff5ee014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c30d expref: 6 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390301.929161:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4600, rc 0) 00000100:00100000:1.0:1785390301.929236:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+6:13731:x1872116847850624:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 662us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390301.929244:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 77 00000100:00100000:2.0:1785390301.946191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390301.946401:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847850752 00000100:00100000:3.0:1785390301.946415:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847850752 00000100:00100000:3.0:1785390301.946493:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:3.0:1785390301.946507:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+6:13731:x1872116847850752:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1785390301.951003:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+6:13731:x1872116847850752:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 4474us (4800us total) trans 0 rc -2/-2 00000100:00100000:3.0:1785390301.951021:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 78 00000100:00100000:2.0:1785390301.966734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390301.967143:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847850880 00000100:00100000:1.0:1785390301.967157:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847850880 00000100:00100000:1.0:1785390301.967225:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:1.0:1785390301.967237:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5354c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+6:13731:x1872116847850880:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785390301.967260:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390301.967294:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4c00/0x33dffe75ff5ee01b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c314 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390301.967354:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4c00/0x33dffe75ff5ee01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c314 expref: 7 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390301.967367:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4c00/0x33dffe75ff5ee01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c314 expref: 7 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390301.967378:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4c00, rc 0) 00000100:00100000:1.0:1785390301.967455:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5354c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+7:13731:x1872116847850880:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 220us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390301.967463:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 79 00000100:00100000:2.0:1785390301.987720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390301.987880:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851008 00000100:00100000:3.0:1785390301.987893:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851008 00000100:00100000:3.0:1785390301.987975:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1785390301.987997:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+7:13731:x1872116847851008:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1785390301.988396:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13731:x1872116847851008:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 411us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390301.988404:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 80 00000100:00100000:3.0:1785390301.997087:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390302.007324:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851136 00000100:00100000:2.0:1785390302.007346:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851136 00000100:00100000:2.0:1785390302.007444:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1785390302.007457:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13731:x1872116847851136:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785390302.009610:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13731:x1872116847851136:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 2145us (12529us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.009625:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 81 00000100:00100000:2.0:1785390302.028715:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390302.028820:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851264 00000100:00100000:1.0:1785390302.028833:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851264 00000100:00100000:1.0:1785390302.028911:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:1.0:1785390302.028923:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13749:x1872116847851264:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785390302.029331:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13749:x1872116847851264:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 410us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390302.029340:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 82 00000100:00100000:0.0:1785390302.070333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390302.070441:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851392 00000100:00100000:2.0:1785390302.070453:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851392 00000100:00100000:2.0:1785390302.070543:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1785390302.070554:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13749:x1872116847851392:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390302.071154:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13749:x1872116847851392:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 600us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.071164:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 83 00000100:00100000:2.0:1785390302.094131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390302.094245:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851520 00000100:00100000:3.0:1785390302.094257:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851520 00000100:00100000:3.0:1785390302.094329:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1785390302.094339:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+8:13731:x1872116847851520:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1785390302.094362:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390302.094385:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf535ef5600/0x33dffe75ff5ee022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c33e expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.094424:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf535ef5600/0x33dffe75ff5ee022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c33e expref: 9 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.094437:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf535ef5600/0x33dffe75ff5ee022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c33e expref: 9 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.094448:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5600, rc 0) 00000100:00100000:3.0:1785390302.094563:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+9:13731:x1872116847851520:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 187us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.094578:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 84 00000100:00100000:3.0:1785390302.107700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390302.117090:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851648 00000100:00100000:2.0:1785390302.117112:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851648 00000100:00100000:2.0:1785390302.117203:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:2.0:1785390302.117217:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+9:13731:x1872116847851648:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:2.0:1785390302.117274:0:14290:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1785390302.117306:0:14290:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1785390302.117311:0:14290:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1785390302.117315:0:14290:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1785390302.117318:0:14290:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1785390302.128878:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+9:13731:x1872116847851648:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 11647us (21176us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.128897:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 85 00000100:00100000:0.0:1785390302.143083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390302.143195:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851776 00000100:00100000:1.0:1785390302.143208:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851776 00000100:00100000:1.0:1785390302.143273:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:1.0:1785390302.143293:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+9:13731:x1872116847851776:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1785390302.143315:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390302.143338:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c345 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390302.143372:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 10 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390302.143402:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 10 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390302.143414:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4400, rc 0) 00000100:00100000:1.0:1785390302.143488:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13731:x1872116847851776:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 196us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390302.143495:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 86 00000100:00100000:3.0:1785390302.147572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390302.147949:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847851904 00000100:00100000:2.0:1785390302.147961:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847851904 00000100:00100000:2.0:1785390302.148047:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:2.0:1785390302.148060:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13731:x1872116847851904:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1785390302.148459:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13731:x1872116847851904:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 401us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.148468:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 87 00000100:00100000:0.0:1785390302.156855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390302.157184:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852032 00000100:00100000:3.0:1785390302.157197:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852032 00000100:00100000:3.0:1785390302.157261:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:3.0:1785390302.157271:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13731:x1872116847852032:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1785390302.158302:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13731:x1872116847852032:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 1029us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.158312:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 88 00000100:00100000:0.0:1785390302.181875:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390302.182289:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852160 00000100:00100000:1.0:1785390302.182302:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852160 00000100:00100000:1.0:1785390302.182359:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:1.0:1785390302.182370:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13753:x1872116847852160:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785390302.182739:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13753:x1872116847852160:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 369us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390302.182749:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 89 00000100:00100000:0.0:1785390302.192580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390302.200008:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852288 00000100:00100000:2.0:1785390302.200030:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852288 00000100:00100000:2.0:1785390302.200223:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:2.0:1785390302.200234:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13753:x1872116847852288:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390302.202706:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13753:x1872116847852288:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 2461us (10227us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.202721:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 90 00000100:00100000:0.0:1785390302.224998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390302.226814:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852416 00000100:00100000:3.0:1785390302.226831:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852416 00000100:00100000:3.0:1785390302.226909:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1785390302.226918:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1872116847852416:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:3.0:1785390302.226956:0:14295:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf@192.168.202.54@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:3.0:1785390302.227011:0:14295:0:(genops.c:1406:class_connect()) connect: client 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf, cookie 0x33dffe75ff5ee030 00000004:00100000:3.0:1785390302.227059:0:14295:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1785390302.227072:0:14295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1785390302.346612:0:14295:0:(import.c:65:import_set_state_nolock()) ffff8cf4012d1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785390302.346719:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2356:x1872116847852416:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 119798us (121734us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.346732:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1785390302.354373:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390302.354406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390302.354563:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852544 00000100:00100000:1.0:1785390302.354575:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852544 00000100:00080000:0.0:1785390302.354952:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390302.355564:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852672 00000100:00100000:1.0:1785390302.355571:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852672 00000100:00100000:2.0:1785390302.367564:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1785390302.367598:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:0:x1872116847852544:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785390302.367665:0:14295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785390302.368745:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:0:x1872116847852544:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 1157us (14376us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.368759:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:2.0:1785390302.368796:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:2.0:1785390302.368806:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13731:x1872116847852672:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785390302.368833:0:14295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785390302.368860:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13731:x1872116847852672:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 57us (14452us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.368866:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1785390302.379233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390302.379756:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852800 00000100:00100000:3.0:1785390302.379769:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852800 00000100:00100000:3.0:1785390302.379834:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:3.0:1785390302.379846:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13731:x1872116847852800:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:3.0:1785390302.379961:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13731:x1872116847852800:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 117us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.379969:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1785390302.385969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390302.386018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390302.386079:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847852928 00000100:00100000:1.0:1785390302.386097:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847852928 00000100:00100000:1.0:1785390302.386173:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390302.386184:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1872116847852928:12345-192.168.202.54@tcp:8:mount.lustre.0 00000100:00100000:3.0:1785390302.386185:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853184 00000100:00100000:3.0:1785390302.386198:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853184 00010000:00080000:1.0:1785390302.386232:0:14934:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf@192.168.202.54@tcp t0 exp 0000000000000000 cur 610 last 0 00000100:00100000:3.0:1785390302.386262:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 91 00000020:00000080:1.0:1785390302.386286:0:14934:0:(genops.c:1406:class_connect()) connect: client 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf, cookie 0x33dffe75ff5ee037 00000100:00100000:3.0:1785390302.386288:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:2359:x1872116847853184:12345-192.168.202.54@tcp:400:kworker.0 00002000:00100000:1.0:1785390302.386320:0:14934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf/ffff8cf535a52000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1785390302.386336:0:14934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1785390302.386445:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:2359:x1872116847853184:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 171us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.386455:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 91 00002000:00080000:1.0:1785390302.386828:0:14934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1785390302.386868:0:14934:0:(import.c:65:import_set_state_nolock()) ffff8cf535a51000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1785390302.386925:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2356:x1872116847852928:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 741us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390302.386933:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1785390302.405136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390302.405263:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853056 00000100:00100000:3.0:1785390302.405274:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853056 00000100:00100000:3.0:1785390302.405331:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1785390302.405340:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1872116847853056:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:3.0:1785390302.405382:0:14931:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf@192.168.202.54@tcp t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:3.0:1785390302.405414:0:14931:0:(genops.c:1406:class_connect()) connect: client 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf, cookie 0x33dffe75ff5ee03e 00002000:00100000:3.0:1785390302.405427:0:14931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf/ffff8cf4012d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1785390302.405450:0:14931:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1785390302.405792:0:14931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1785390302.405825:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf4012d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1785390302.405898:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2356:x1872116847853056:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 543us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.405906:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1785390302.419300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390302.421657:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853312 00000100:00100000:1.0:1785390302.421669:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853312 00000100:00100000:1.0:1785390302.421729:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1785390302.421738:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13731:x1872116847853312:12345-192.168.202.54@tcp:33:mount.lustre.0 00000004:00080000:2.0:1785390302.424556:0:14298:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2753us 00000004:00200000:2.0:1785390302.497364:0:14298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1785390302.498325:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13731:x1872116847853312:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 76581us (79028us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390302.498340:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000040:00080000:2.0:1785390302.678784:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1785390302.872370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390302.872453:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853440 00000100:00100000:3.0:1785390302.872474:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853440 00010000:00010000:1.0:1785390302.872491:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390302.872585:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:3.0:1785390302.872596:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13774:x1872116847853440:12345-192.168.202.54@tcp:101:mkdir.0 00010000:00010000:3.0:1785390302.872624:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390302.872655:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4600/0x33dffe75ff5ee045 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c36f expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.872743:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5400/0x33dffe75ff5ee04c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.872760:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5400/0x33dffe75ff5ee04c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.872797:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5400/0x33dffe75ff5ee04c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390302.873071:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1785390302.873076:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390302.873180:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5400/0x33dffe75ff5ee04c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.873211:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4600/0x33dffe75ff5ee045 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c36f expref: 8 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.873230:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5400/0x33dffe75ff5ee04c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c36f expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390302.873239:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:3.0:1785390302.873242:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1785390302.873246:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5400, rc 0) 00000100:00100000:3.0:1785390302.873335:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:13774:x1872116847853440:12345-192.168.202.54@tcp:101:mkdir.0 Request processed in 741us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390302.873343:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00010000:00010000:3.0:1785390303.897145:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390304.278340:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879315968:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.278433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390304.278550:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1785390304.278557:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879315584:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.278597:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390304.278623:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879316096:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.278645:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390304.278687:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879315840:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.278716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390304.278756:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1785390304.278762:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879315712:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.278786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390304.278803:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879316224:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.278838:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390304.278870:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315584 00000100:00100000:2.0:1785390304.278879:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315584 00000100:00100000:2.0:1785390304.278935:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785390304.278944:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879315584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.279004:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879315584:12345-0@lo:400:kworker.0 Request processed in 61us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390304.279013:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1785390304.279256:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315840 00000100:00100000:2.0:1785390304.279271:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315840 00000100:00100000:2.0:1785390304.279310:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315712 00000100:00100000:2.0:1785390304.279313:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315712 00000100:00100000:2.0:1785390304.279330:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785390304.279336:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879315840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.279375:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879315840:12345-0@lo:400:kworker.0 Request processed in 39us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390304.279381:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1785390304.279392:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785390304.279398:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879315712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.279441:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879315712:12345-0@lo:400:kworker.0 Request processed in 43us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390304.284611:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1785390304.284735:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879315968 00000100:00100000:2.0:1785390304.284772:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879315968 00000100:00100000:2.0:1785390304.284918:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316096 00000100:00100000:2.0:1785390304.284923:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316096 00000100:00100000:2.0:1785390304.284947:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316224 00000100:00100000:2.0:1785390304.284950:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316224 00000100:00100000:2.0:1785390304.284970:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1785390304.284980:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879315968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.285166:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879315968:12345-0@lo:400:kworker.0 Request processed in 187us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390304.285174:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1785390304.285187:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785390304.285193:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879316096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.285224:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879316096:12345-0@lo:400:kworker.0 Request processed in 32us (6579us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390304.285231:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785390304.285242:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785390304.285249:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879316224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.285289:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1872116879316224:12345-0@lo:400:kworker.0 Request processed in 42us (6451us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390304.285294:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1785390304.285366:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879315712:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.285383:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1872116879316224:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.285398:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1785390304.285416:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879315840:0@lo:400:kworker.0 00000100:00080000:0.0:1785390304.285610:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390304.285616:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390304.285620:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1785390304.290357:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879315584:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.290445:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879316096:0@lo:400:kworker.0 00000100:00100000:2.0:1785390304.292953:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879315968:0@lo:400:kworker.0 00000100:00100000:3.0:1785390304.302000:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879316352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1785390304.302110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390304.302303:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316352 00000100:00100000:1.0:1785390304.302314:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316352 00000100:00100000:1.0:1785390304.302381:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785390304.302392:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879316352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1785390304.302434:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390304.302495:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879316352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390304.302503:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785390304.302591:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879316352:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1785390304.435251:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf 00010000:00010000:1.0:1785390304.917819:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390305.352403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.352581:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853568 00000100:00100000:2.0:1785390305.352594:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853568 00000100:00100000:2.0:1785390305.352688:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:2.0:1785390305.352700:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:13827:x1872116847853568:12345-192.168.202.54@tcp:41:lfs.0 00000004:00000024:2.0:1785390305.352762:0:14295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785390305.352871:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:13827:x1872116847853568:12345-192.168.202.54@tcp:41:lfs.0 Request processed in 173us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.352879:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:0.0:1785390305.353038:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390305.365725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390305.365825:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853696 00000100:00100000:1.0:1785390305.365840:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853696 00000100:00100000:1.0:1785390305.365920:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1785390305.365932:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13827:x1872116847853696:12345-192.168.202.54@tcp:13:lfs.0 00002000:00000024:1.0:1785390305.365998:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390305.366101:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:13827:x1872116847853696:12345-192.168.202.54@tcp:13:lfs.0 Request processed in 172us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390305.366109:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:0.0:1785390305.366171:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390305.378789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390305.378900:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853824 00000100:00100000:1.0:1785390305.378913:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853824 00000100:00080000:0.0:1785390305.379040:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390305.379120:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390305.379133:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:13827:x1872116847853824:12345-192.168.202.54@tcp:13:lfs.0 00002000:00000024:1.0:1785390305.379175:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390305.379278:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:13827:x1872116847853824:12345-192.168.202.54@tcp:13:lfs.0 Request processed in 148us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390305.379286:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1785390305.671052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390305.671177:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847853952 00000100:00100000:0.0:1785390305.671307:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847853952 00000100:00100000:0.0:1785390305.671380:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1785390305.671393:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+10:13860:x1872116847853952:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785390305.671558:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390305.671584:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ee053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c376 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390305.671624:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ee053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c376 expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390305.671643:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503717400/0x33dffe75ff5ee053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c376 expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390305.671654:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717400, rc 0) 00000100:00100000:0.0:1785390305.671722:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13860:x1872116847853952:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 332us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390305.671732:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 93 00000100:00100000:0.0:1785390305.680019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.680126:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854080 00000100:00100000:2.0:1785390305.680139:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854080 00000100:00100000:2.0:1785390305.680204:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:2.0:1785390305.680215:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13860:x1872116847854080:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:2.0:1785390305.681193:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13860:x1872116847854080:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 976us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.681203:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 94 00000100:00100000:1.0:1785390305.698939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.703787:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854208 00000100:00100000:2.0:1785390305.703807:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854208 00000100:00100000:2.0:1785390305.703953:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:2.0:1785390305.703965:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13860:x1872116847854208:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785390305.704365:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50dd4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13860:x1872116847854208:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 401us (5437us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.704381:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 95 00000100:00100000:3.0:1785390305.711841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390305.712115:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854336 00000100:00100000:0.0:1785390305.712129:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854336 00000100:00100000:0.0:1785390305.712189:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:0.0:1785390305.712199:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13866:x1872116847854336:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1785390305.713886:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13866:x1872116847854336:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 1678us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390305.713898:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 96 00000100:00100000:0.0:1785390305.745803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.745943:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854464 00000100:00100000:2.0:1785390305.745956:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854464 00000100:00100000:2.0:1785390305.746068:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:2.0:1785390305.746080:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13866:x1872116847854464:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390305.746460:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13866:x1872116847854464:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 382us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.746469:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 97 00000100:00100000:1.0:1785390305.751856:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390305.752004:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854592 00000100:00100000:0.0:1785390305.752016:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854592 00000100:00100000:0.0:1785390305.752072:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:0.0:1785390305.752082:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13860:x1872116847854592:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1785390305.752104:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390305.752129:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ee05a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3a0 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390305.752165:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ee05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a0 expref: 12 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390305.752178:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716200/0x33dffe75ff5ee05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a0 expref: 12 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390305.752189:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716200, rc 0) 00000100:00100000:0.0:1785390305.752265:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13860:x1872116847854592:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 185us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390305.752274:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 98 00000100:00100000:0.0:1785390305.754860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390305.754930:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854720 00000100:00100000:1.0:1785390305.754939:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854720 00000100:00100000:1.0:1785390305.754990:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:1.0:1785390305.755001:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13860:x1872116847854720:12345-192.168.202.54@tcp:256:mount.lustre.0 20000000:01000000:1.0:1785390305.755028:0:14289:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1785390305.755055:0:14289:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1785390305.755059:0:14289:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1785390305.755063:0:14289:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1785390305.755065:0:14289:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1785390305.760803:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13860:x1872116847854720:12345-192.168.202.54@tcp:256:mount.lustre.0 Request processed in 5788us (5935us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390305.760819:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 99 00000100:00100000:3.0:1785390305.768866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.769104:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854848 00000100:00100000:2.0:1785390305.769117:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854848 00000100:00100000:2.0:1785390305.769179:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:2.0:1785390305.769189:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13860:x1872116847854848:12345-192.168.202.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1785390305.769213:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390305.769235:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3a7 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390305.769285:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 13 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390305.769299:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 13 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390305.769311:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121ca00, rc 0) 00000100:00100000:2.0:1785390305.770874:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13860:x1872116847854848:12345-192.168.202.54@tcp:101:mount.lustre.0 Request processed in 1679us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.770884:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 100 00000100:00100000:3.0:1785390305.780797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390305.784753:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847854976 00000100:00100000:0.0:1785390305.784770:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847854976 00000100:00100000:0.0:1785390305.784892:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:0.0:1785390305.784904:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13860:x1872116847854976:12345-192.168.202.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1785390305.785284:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13860:x1872116847854976:12345-192.168.202.54@tcp:501:mount.lustre.0 Request processed in 381us (4498us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390305.785293:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 101 00000100:00100000:1.0:1785390305.800780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.802911:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855104 00000100:00100000:2.0:1785390305.802927:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855104 00000100:00100000:2.0:1785390305.803047:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:2.0:1785390305.803059:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13860:x1872116847855104:12345-192.168.202.54@tcp:503:mount.lustre.0 00000100:00100000:2.0:1785390305.803679:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13860:x1872116847855104:12345-192.168.202.54@tcp:503:mount.lustre.0 Request processed in 621us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.803689:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 102 00000100:00100000:1.0:1785390305.817773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390305.821776:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855232 00000100:00100000:0.0:1785390305.821794:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855232 00000100:00100000:1.0:1785390305.826232:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:1.0:1785390305.826279:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13868:x1872116847855232:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1785390305.828090:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13868:x1872116847855232:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 1810us (10660us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390305.828103:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 103 00000100:00100000:0.0:1785390305.833829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.833927:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855360 00000100:00100000:2.0:1785390305.833938:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855360 00000100:00100000:2.0:1785390305.834035:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:2.0:1785390305.834046:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13868:x1872116847855360:12345-192.168.202.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1785390305.834352:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13868:x1872116847855360:12345-192.168.202.54@tcp:502:llog_process_th.0 Request processed in 308us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.834361:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 104 00000100:00100000:0.0:1785390305.854995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.855273:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855488 00000100:00100000:2.0:1785390305.855286:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855488 00000100:00100000:2.0:1785390305.855351:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:2.0:1785390305.855361:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1872116847855488:12345-192.168.202.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1785390305.855401:0:14296:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1a56b208-1f4e-4386-b3a5-8a55bf5a472f@192.168.202.54@tcp t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:2.0:1785390305.855761:0:14296:0:(genops.c:1406:class_connect()) connect: client 1a56b208-1f4e-4386-b3a5-8a55bf5a472f, cookie 0x33dffe75ff5ee068 00000004:00100000:2.0:1785390305.855802:0:14296:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1785390305.855943:0:14296:0:(import.c:65:import_set_state_nolock()) ffff8cf4027e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785390305.856026:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2356:x1872116847855488:12345-192.168.202.54@tcp:38:mount.lustre.0 Request processed in 665us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.856035:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390305.867764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.868058:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855616 00000100:00100000:2.0:1785390305.868071:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855616 00000100:00100000:2.0:1785390305.868165:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1785390305.868177:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:0:x1872116847855616:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785390305.868240:0:14295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1785390305.868362:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390305.868824:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:0:x1872116847855616:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 648us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.868834:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1785390305.873263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.875160:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855744 00000100:00100000:2.0:1785390305.875174:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855744 00000100:00100000:2.0:1785390305.875318:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:2.0:1785390305.875331:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13860:x1872116847855744:12345-192.168.202.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1785390305.875381:0:14297:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1785390305.875484:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13860:x1872116847855744:12345-192.168.202.54@tcp:41:mount.lustre.0 Request processed in 155us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.875492:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:0.0:1785390305.883936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390305.884048:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847855872 00000100:00100000:2.0:1785390305.884061:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847855872 00000100:00100000:2.0:1785390305.884231:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1785390305.884243:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13860:x1872116847855872:12345-192.168.202.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1785390305.884757:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13860:x1872116847855872:12345-192.168.202.54@tcp:40:mount.lustre.0 Request processed in 514us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.884766:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1785390305.892866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390305.892912:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390305.893050:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856256 00000100:00100000:3.0:1785390305.893063:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856256 00000100:00100000:3.0:1785390305.893142:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:3.0:1785390305.893154:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13860:x1872116847856256:12345-192.168.202.54@tcp:33:mount.lustre.0 00000100:00100000:1.0:1785390305.895379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000004:00200000:3.0:1785390305.895796:0:14299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1785390305.896014:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13860:x1872116847856256:12345-192.168.202.54@tcp:33:mount.lustre.0 Request processed in 2851us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390305.896026:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1785390305.904720:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856000 00000100:00100000:2.0:1785390305.904739:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856000 00000100:00100000:2.0:1785390305.904807:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856128 00000100:00100000:2.0:1785390305.904828:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856128 00000100:00100000:2.0:1785390305.904854:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:2.0:1785390305.904863:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1872116847856000:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785390305.904903:0:14931:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1a56b208-1f4e-4386-b3a5-8a55bf5a472f@192.168.202.54@tcp t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:2.0:1785390305.904946:0:14931:0:(genops.c:1406:class_connect()) connect: client 1a56b208-1f4e-4386-b3a5-8a55bf5a472f, cookie 0x33dffe75ff5ee06f 00002000:00100000:2.0:1785390305.904960:0:14931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a56b208-1f4e-4386-b3a5-8a55bf5a472f/ffff8cf4027e1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785390305.904974:0:14931:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785390305.905745:0:14931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1785390305.905789:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf4027e5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785390305.905927:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2356:x1872116847856000:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 1062us (13011us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.905936:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:2.0:1785390305.905962:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:2.0:1785390305.905967:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1872116847856128:12345-192.168.202.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1785390305.905986:0:14931:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1a56b208-1f4e-4386-b3a5-8a55bf5a472f@192.168.202.54@tcp t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:2.0:1785390305.906021:0:14931:0:(genops.c:1406:class_connect()) connect: client 1a56b208-1f4e-4386-b3a5-8a55bf5a472f, cookie 0x33dffe75ff5ee076 00002000:00100000:2.0:1785390305.906027:0:14931:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a56b208-1f4e-4386-b3a5-8a55bf5a472f/ffff8cf4027e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1785390305.906047:0:14931:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1785390305.906288:0:14931:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1785390305.906304:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf4027e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1785390305.906331:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2356:x1872116847856128:12345-192.168.202.54@tcp:8:mount.lustre.0 Request processed in 362us (10959us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390305.906349:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00010000:00010000:3.0:1785390305.946161:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390306.157300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390306.158183:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856384 00000100:00100000:2.0:1785390306.158213:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856384 00000100:00100000:2.0:1785390306.158351:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785390306.158364:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:13889:x1872116847856384:12345-192.168.202.54@tcp:101:mkdir.0 00010000:00010000:2.0:1785390306.158391:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390306.158431:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee07d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3d1 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390306.158509:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390306.158555:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390306.158579:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390306.158826:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785390306.158831:0:14297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390306.158912:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390306.158958:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee07d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390306.158977:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390306.158987:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:2.0:1785390306.158990:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390306.158995:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d000, rc 0) 00000100:00100000:2.0:1785390306.159087:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+7:13889:x1872116847856384:12345-192.168.202.54@tcp:101:mkdir.0 Request processed in 725us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390306.159095:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785390306.850012:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1785390306.850039:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879316480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1785390306.850132:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390306.850945:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316480 00000100:00100000:3.0:1785390306.850956:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316480 00000100:00100000:3.0:1785390306.851189:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785390306.851201:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879316480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390306.851255:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390306.851321:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879316480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390306.851329:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1785390306.851386:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879316480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785390306.852284:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1785390306.902097:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf 00000001:00100000:2.0:1785390306.902120:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00010000:00010000:0.0:1785390306.979789:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785390307.483003:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00000001:00100000:2.0:1785390307.483026:0:5824:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf 00010000:00010000:1.0:1785390308.007816:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1785390309.016558:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390309.397846:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879316736:0@lo:400:kworker.0 00000100:00100000:0.0:1785390309.397945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390309.398027:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879317248:0@lo:400:kworker.0 00000100:00100000:0.0:1785390309.398062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390309.398089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390309.398095:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879316864:0@lo:400:kworker.0 00000100:00100000:0.0:1785390309.398115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390309.398164:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317248 00000100:00100000:2.0:1785390309.398175:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317248 00000100:00100000:1.0:1785390309.398254:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879316992:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398259:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1785390309.398270:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879317248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390309.398287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390309.398306:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785390309.398311:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879316608:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398334:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879317248:12345-0@lo:400:kworker.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390309.398339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390309.398342:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1785390309.398358:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879317120:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398359:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316992 00000100:00100000:2.0:1785390309.398362:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316992 00000100:00100000:2.0:1785390309.398377:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785390309.398380:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390309.398382:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390309.398404:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316736 00000100:00100000:1.0:1785390309.398408:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316736 00000100:00100000:2.0:1785390309.398426:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879316992:12345-0@lo:400:kworker.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390309.398432:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1785390309.398435:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316864 00000100:00100000:1.0:1785390309.398437:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316864 00000100:00100000:2.0:1785390309.398441:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317120 00000100:00100000:2.0:1785390309.398443:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317120 00000100:00100000:2.0:1785390309.398457:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1785390309.398462:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879317120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390309.398465:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785390309.398472:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879316736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398489:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879317120:12345-0@lo:400:kworker.0 Request processed in 27us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390309.398500:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879316736:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390309.398502:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1785390309.398506:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1785390309.398517:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1785390309.398548:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390309.398578:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879316864:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390309.398584:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1785390309.398589:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879317120:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398600:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879316992:0@lo:400:kworker.0 00000100:00100000:1.0:1785390309.398631:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879316608 00000100:00100000:1.0:1785390309.398634:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879316608 00000100:00100000:1.0:1785390309.398656:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1785390309.398661:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879316608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390309.398694:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879316608:12345-0@lo:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390309.398703:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1785390309.398727:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879317376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390309.398755:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390309.398967:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879316608:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398990:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879316864:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.398999:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879316736:0@lo:400:kworker.0 00000100:00100000:2.0:1785390309.399008:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879317248:0@lo:400:kworker.0 00000100:00080000:0.0:1785390309.400042:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390309.400050:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390309.400054:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390309.400142:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317376 00000100:00100000:3.0:1785390309.400150:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317376 00000100:00100000:3.0:1785390309.400197:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1785390309.400205:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879317376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390309.400251:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390309.400326:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879317376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390309.400333:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1785390309.400434:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879317376:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1785390309.564855:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00010000:00010000:3.0:1785390310.038732:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1785390310.164223:0:16165:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1785390311.061760:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390311.348120:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348161:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390311.348296:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856768 00000100:00100000:1.0:1785390311.348307:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856768 00000100:00100000:1.0:1785390311.348366:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856896 00000100:00100000:1.0:1785390311.348369:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856896 00000100:00100000:1.0:1785390311.348384:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857152 00000100:00100000:1.0:1785390311.348403:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857152 00000100:00100000:1.0:1785390311.348420:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857280 00000100:00100000:1.0:1785390311.348422:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857280 00000100:00100000:1.0:1785390311.348439:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1785390311.348451:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2358:x1872116847856768:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390311.348578:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2358:x1872116847856768:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 128us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390311.348587:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1785390311.348607:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390311.348613:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2357:x1872116847856896:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390311.348637:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2357:x1872116847856896:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390311.348643:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390311.348653:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1785390311.348659:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2357:x1872116847857152:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390311.348677:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2357:x1872116847857152:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 19us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390311.348684:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1785390311.348692:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1785390311.348698:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847857280:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390311.348716:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847857280:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 18us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390311.348722:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:1.0:1785390311.348742:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856640 00000100:00100000:1.0:1785390311.348751:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856640 00000100:00100000:1.0:1785390311.348778:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857024 00000100:00100000:1.0:1785390311.348781:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857024 00000100:00100000:1.0:1785390311.348794:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1785390311.348799:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2357:x1872116847856640:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390311.348826:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2357:x1872116847856640:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390311.348832:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1785390311.348843:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:1.0:1785390311.348849:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2358:x1872116847857024:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390311.348872:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2358:x1872116847857024:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 22us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390311.348878:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00080000:1.0:1785390311.348898:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1785390311.348903:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785390311.348905:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1785390311.349141:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847856512 00000100:00100000:2.0:1785390311.349145:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847856512 00000100:00100000:2.0:1785390311.349179:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:2.0:1785390311.349186:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2358:x1872116847856512:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390311.349226:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2358:x1872116847856512:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 41us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390311.349233:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 106 00000100:00100000:3.0:1785390311.957681:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879317504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390311.957770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390311.957858:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317504 00000100:00100000:3.0:1785390311.957866:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317504 00000100:00100000:3.0:1785390311.957930:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1785390311.957939:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879317504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390311.957982:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390311.958026:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879317504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390311.958034:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1785390311.958056:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390311.958094:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879317504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785390312.090713:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1785390312.942055:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1785390313.109682:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390314.139660:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390314.522188:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879317632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390314.522309:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390314.524113:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317632 00000100:00100000:2.0:1785390314.524126:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317632 00000100:00100000:2.0:1785390314.524207:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1785390314.524229:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879317632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390314.524273:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390314.524341:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879317632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390314.524350:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1785390314.524774:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390314.524825:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879317632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1785390314.536695:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879318016:0@lo:400:kworker.0 00000100:00100000:2.0:1785390314.536798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390314.536846:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1785390314.536852:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879318144:0@lo:400:kworker.0 00000100:00100000:2.0:1785390314.536872:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390314.537115:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:374ce4d4-733e-4fe2-9421-711e41cbfd01:3307:1872116879317760:0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390314.537208:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879318272:0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390314.537265:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1785390314.537271:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879317888:0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537295:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390314.537327:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879318016 00000100:00100000:0.0:1785390314.537336:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879318016 00000100:00100000:0.0:1785390314.537394:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879318144 00000100:00100000:0.0:1785390314.537397:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879318144 00000100:00100000:0.0:1785390314.537420:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879318272 00000100:00100000:0.0:1785390314.537422:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879318272 00000100:00100000:0.0:1785390314.537439:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785390314.537448:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879318016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537512:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1872116879318016:12345-0@lo:400:kworker.0 Request processed in 63us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390314.537561:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785390314.537582:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785390314.537588:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879318144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537616:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879318144:12345-0@lo:400:kworker.0 Request processed in 29us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390314.537621:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1785390314.537643:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785390314.537649:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879318272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537677:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1872116879318272:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390314.537682:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1785390314.537700:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317888 00000100:00100000:0.0:1785390314.537703:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317888 00000100:00100000:0.0:1785390314.537729:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785390314.537735:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879317888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537772:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879317888:12345-0@lo:400:kworker.0 Request processed in 38us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390314.537777:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1785390314.537816:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879318144:0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537826:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1872116879318016:0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537851:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879317888:0@lo:400:kworker.0 00000100:00100000:0.0:1785390314.537860:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1872116879318272:0@lo:400:kworker.0 00000100:00080000:0.0:1785390314.537879:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390314.537891:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1785390314.539327:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879317760 00000100:00100000:2.0:1785390314.539340:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879317760 00000100:00100000:2.0:1785390314.539408:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1785390314.539418:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3307:x1872116879317760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390314.539493:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3307:x1872116879317760:12345-0@lo:400:kworker.0 Request processed in 77us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390314.539500:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1785390314.539750:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:374ce4d4-733e-4fe2-9421-711e41cbfd01:3307:1872116879317760:0@lo:400:kworker.0 00010000:00010000:1.0:1785390315.169750:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1785390315.747349:0:16313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4fcfcdf0 20000000:00000080:0.0:1785390315.747370:0:16313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf5176e5c00 uarg=0000000000000000 20000000:01000000:0.0:1785390315.747415:0:16313:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785390315.747422:0:16313:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1785390315.747428:0:16313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1785390315.754104:0:16314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1785390315.754342:0:16313:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1785390315.772893:0:16313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1785390315.773022:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773046:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 18 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773054:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 18 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773061:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773072:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 12 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773078:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773087:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773146:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773175:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.773271:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318400:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390315.773413:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 12 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773421:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 12 pid: 14289 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.773430:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318528:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390315.773464:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773472:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.773481:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318656:0@lo:104: 00000100:00100000:0.0:1785390315.773566:0:16313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785390315.773873:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 18 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.773883:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 18 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.773892:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318784:0@lo:104: 00000100:00100000:0.0:1785390315.773915:0:16313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1785390315.779477:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 18 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.779500:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 18 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.779552:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318912:0@lo:104: 00000100:00100000:0.0:1785390315.779629:0:16313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390315.779970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390315.780011:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857536 00000100:00100000:1.0:1785390315.780020:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857536 00010000:00010000:1.0:1785390315.780061:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 13 pid: 14289 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390315.780098:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1785390315.780107:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2359:x1872116847857536:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390315.780122:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390315.780129:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 13 pid: 14289 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.780141:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 13 pid: 14289 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.780174:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390315.781352:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879318656 00000100:00100000:3.0:1785390315.781363:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879318656 00000100:00100000:3.0:1785390315.781402:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879318784 00000100:00100000:3.0:1785390315.781406:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879318784 00000100:00100000:3.0:1785390315.781419:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785390315.781427:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+4:16313:x1872116879318656:12345-0@lo:104: 00010000:00010000:3.0:1785390315.781444:0:14279:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781518:0:14279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785390315.781539:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+4:16313:x1872116879318656:12345-0@lo:104: Request processed in 98us (7958us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390315.781548:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1785390315.781582:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1785390315.781588:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:16313:x1872116879318784:12345-0@lo:104: 00010000:00010000:3.0:1785390315.781596:0:14279:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781635:0:14279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1785390315.781640:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:16313:x1872116879318784:12345-0@lo:104: Request processed in 53us (7725us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390315.781646:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1785390315.781669:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1785390315.781676:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781683:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717a00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390315.781689:0:14283:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781699:0:14283:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390315.781707:0:14283:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390315.781714:0:14283:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785390315.781752:0:14283:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781758:0:14283:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390315.781780:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781798:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf503717a00/0x33dffe75ff5edf03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edf0a expref: -99 pid: 15601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781814:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390315.781818:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781824:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc5400 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390315.781827:0:14283:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781835:0:14283:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390315.781842:0:14283:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390315.781848:0:14283:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785390315.781860:0:14283:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781866:0:14283:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390315.781884:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781892:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc5400/0x33dffe75ff5eddc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5eddcf expref: -99 pid: 14930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.781901:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390315.781908:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390315.781910:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390315.781936:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879319168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390315.781975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390315.782103:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2359:x1872116847857536:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1993us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390315.782113:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:1.0:1785390315.782130:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319168 00000100:00100000:1.0:1785390315.782133:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319168 00010000:00010000:1.0:1785390315.782148:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 19 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390315.782175:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1785390315.782181:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879319168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390315.782190:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390315.782196:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 19 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.782489:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 19 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.782507:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390315.782779:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879319168:12345-0@lo:103:ldlm_bl.0 Request processed in 597us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390315.782787:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1785390315.782812:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390315.782824:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879319040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1785390315.783045:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879318912 00000100:00100000:2.0:1785390315.783051:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879318912 00000100:00100000:2.0:1785390315.783090:0:14278:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1785390315.785751:0:16313:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5088bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1785390315.785797:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318400:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390315.785811:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf5421f4400/0x33dffe75ff5ee029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c345 expref: 12 pid: 14289 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.785831:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318528:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390315.785842:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318656:0@lo:104: 00010000:00010000:0.0:1785390315.785852:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf53ffc4000/0x33dffe75ff5eddcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5eddc8 expref: 18 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.785862:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318784:0@lo:104: 00000100:00100000:0.0:1785390315.785963:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879319168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1785390315.794481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390315.794594:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319040 00000100:00100000:1.0:1785390315.794606:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319040 00010000:00010000:1.0:1785390315.794652:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390315.794686:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785390315.794696:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:3308:x1872116879319040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390315.794713:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390315.794720:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.794732:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.794753:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121c200/0x33dffe75ff5edf0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5edf03 expref: 18 pid: 14290 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.794770:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390315.794822:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:3308:x1872116879319040:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390315.794830:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1785390315.794989:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf402233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879319040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390315.803145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390315.804441:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1785390315.804465:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf52fdaec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:16313:x1872116879318912:12345-0@lo:104: 00010000:00010000:3.0:1785390315.804489:0:14279:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.805018:0:14279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1785390315.805025:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf52fdaec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:374ce4d4-733e-4fe2-9421-711e41cbfd01+3:16313:x1872116879318912:12345-0@lo:104: Request processed in 572us (25396us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390315.805034:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1785390315.805097:0:14283:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1785390315.805103:0:14283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.805111:0:14283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf53ffc4c00 already unused, calling callback (ffffffffc1bbec20) 10000000:00010000:3.0:1785390315.805116:0:14283:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.805125:0:14283:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1785390315.805134:0:14283:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1785390315.805139:0:14283:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1785390315.805855:0:14283:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.805863:0:14283:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1785390315.805890:0:14283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.805897:0:14283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.154@tcp lock: ffff8cf53ffc4c00/0x33dffe75ff5edd7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33dffe75ff5edd82 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390315.805919:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390315.805921:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390315.805923:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390315.805950:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879319296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1785390315.806000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390315.810618:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1872116879318912:0@lo:104: 00010000:00010000:1.0:1785390315.810685:0:16313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.813354:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857408 00000100:00100000:0.0:1785390315.813373:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857408 00010000:00010000:0.0:1785390315.813457:0:14282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.813512:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319296 00000100:00100000:0.0:1785390315.813516:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319296 00010000:00010000:0.0:1785390315.813553:0:14282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 17 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390315.813571:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1785390315.813581:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:2360:x1872116847857408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390315.813622:0:14282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390315.813630:0:14282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.813643:0:14282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.813665:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee061 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3a7 expref: 12 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.813682:0:14282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390315.813852:0:14281:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1785390315.813863:0:14281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1785390315.814340:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:2360:x1872116847857408:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 757us (11205us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390315.814350:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:0.0:1785390315.814375:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1785390315.814384:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:3310:x1872116879319296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1785390315.814394:0:14282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390315.814399:0:14282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 17 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814410:0:14282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 17 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814424:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf50121c600/0x33dffe75ff5edd82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33dffe75ff5edd7b expref: 17 pid: 14288 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814439:0:14282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814461:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814478:0:14282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814485:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814494:0:14282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814502:0:14282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814508:0:14282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716e00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:0.0:1785390315.814513:0:14282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814550:0:14282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814566:0:14282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390315.814577:0:14282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390315.814645:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:3310:x1872116879319296:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (8645us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390315.814651:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1785390315.815974:0:16313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.815989:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390315.815997:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf503716e00/0x33dffe75ff5ee08b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390315.830300:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879319296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1785390316.181882:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390316.463438:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390316.463492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390316.463537:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857664 00000100:00100000:1.0:1785390316.463548:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390316.463550:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857664 00000100:00100000:1.0:1785390316.463569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390316.463610:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:3.0:1785390316.463622:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:2360:x1872116847857664:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390316.463710:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:2360:x1872116847857664:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390316.463718:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 108 00000100:00100000:0.0:1785390316.466499:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857920 00000100:00100000:0.0:1785390316.466546:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857920 00000100:00100000:0.0:1785390316.466609:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858432 00000100:00100000:0.0:1785390316.466612:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858432 00000100:00100000:0.0:1785390316.466635:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785390316.466646:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2360:x1872116847857920:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390316.466726:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2360:x1872116847857920:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 82us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390316.466734:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785390316.466750:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390316.466757:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2360:x1872116847858432:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390316.466783:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2360:x1872116847858432:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 27us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390316.466790:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390316.466824:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858176 00000100:00100000:0.0:1785390316.466829:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858176 00000100:00100000:0.0:1785390316.466863:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:0.0:1785390316.466870:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2360:x1872116847858176:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390316.466900:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2360:x1872116847858176:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 31us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390316.466906:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00080000:0.0:1785390316.466926:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390316.466931:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390316.466934:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390316.479443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390316.479520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390316.479584:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390316.479635:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858048 00000100:00100000:3.0:1785390316.479658:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858048 00000100:00100000:1.0:1785390316.479841:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847857792 00000100:00100000:1.0:1785390316.479846:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847857792 00000100:00100000:2.0:1785390316.479900:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858304 00000100:00100000:2.0:1785390316.479905:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858304 00000100:00100000:3.0:1785390316.479988:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:3.0:1785390316.480000:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2360:x1872116847858048:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390316.480096:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2360:x1872116847858048:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 97us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390316.480104:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1785390316.483269:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1785390316.483292:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2360:x1872116847857792:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390316.483374:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2360:x1872116847857792:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 93us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390316.483390:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1785390316.483480:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:2.0:1785390316.483490:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2360:x1872116847858304:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390316.483536:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2360:x1872116847858304:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 35us (3939us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390316.483543:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00080000:3.0:1785390316.485890:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1785390316.485902:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1785390316.485906:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390317.097843:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390317.097876:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879319424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390317.097988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.109747:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319424 00000100:00100000:2.0:1785390317.109767:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319424 00000100:00100000:2.0:1785390317.113309:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785390317.113327:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879319424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1785390317.113381:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390317.113501:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879319424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (15513us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390317.113509:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1785390317.113595:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879319424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1785390317.116443:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1785390317.207950:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390317.492117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390317.492269:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858560 00000100:00100000:1.0:1785390317.492283:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858560 00000100:00100000:1.0:1785390317.492360:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:1.0:1785390317.492373:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+11:13745:x1872116847858560:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1785390317.492398:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390317.492425:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ee092 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3d8 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390317.492464:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ee092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d8 expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390317.492478:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf5421f4000/0x33dffe75ff5ee092 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d8 expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390317.492489:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4000, rc 0) 00000100:00100000:1.0:1785390317.492582:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13745:x1872116847858560:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 211us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390317.492591:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 109 00000100:00100000:0.0:1785390317.507511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390317.507637:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858688 00000100:00100000:3.0:1785390317.507650:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858688 00000100:00100000:3.0:1785390317.507714:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:3.0:1785390317.507726:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13745:x1872116847858688:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390317.508577:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13745:x1872116847858688:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 852us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.508587:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 110 00000100:00100000:0.0:1785390317.526687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390317.526773:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858816 00000100:00100000:3.0:1785390317.526787:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858816 00000100:00100000:3.0:1785390317.526849:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:3.0:1785390317.526861:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50a16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13745:x1872116847858816:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390317.527150:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50a16b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13745:x1872116847858816:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 280us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.527159:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 111 00000100:00100000:1.0:1785390317.551316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390317.551491:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847858944 00000100:00100000:0.0:1785390317.551503:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847858944 00000100:00100000:0.0:1785390317.551590:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:0.0:1785390317.551601:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+12:13745:x1872116847858944:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390317.551627:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390317.551652:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5ee099 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3df expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.551690:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5ee099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3df expref: 13 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.551703:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf503716a00/0x33dffe75ff5ee099 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3df expref: 13 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.551714:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716a00, rc 0) 00000100:00100000:0.0:1785390317.551788:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13745:x1872116847858944:12345-192.168.202.54@tcp:101:ll_cfg_requeue.0 Request processed in 189us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390317.551797:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 112 00000100:00100000:1.0:1785390317.573516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390317.573576:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859072 00000100:00100000:1.0:1785390317.573589:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859072 00000100:00100000:1.0:1785390317.573649:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:1.0:1785390317.573679:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13745:x1872116847859072:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1785390317.574129:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13745:x1872116847859072:12345-192.168.202.54@tcp:501:ll_cfg_requeue.0 Request processed in 452us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390317.574150:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 113 00000100:00100000:1.0:1785390317.580520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390317.583259:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859200 00000100:00100000:1.0:1785390317.583272:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859200 00000100:00100000:1.0:1785390317.583431:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 114 00000100:00100000:1.0:1785390317.583447:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13745:x1872116847859200:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1785390317.583729:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:13745:x1872116847859200:12345-192.168.202.54@tcp:503:ll_cfg_requeue.0 Request processed in 287us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390317.583739:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 114 10000000:01000000:2.0:1785390317.720838:0:14292:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785390317.720848:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf51f0e5800 from 10 10000000:01000000:2.0:1785390317.720853:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785390317.720910:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.720925:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.720940:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390317.720970:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.721055:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.721112:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390317.721211:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319552 00000100:00100000:3.0:1785390317.721221:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319552 00000100:00100000:3.0:1785390317.721277:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1785390317.721287:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+16:14292:x1872116879319552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390317.721312:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390317.721328:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf535ef5000/0x33dffe75ff5ee0a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ee0a0 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390317.721357:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf535ef5000/0x33dffe75ff5ee0a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ee0a0 expref: 17 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390317.721370:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf535ef5000/0x33dffe75ff5ee0a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ee0a0 expref: 17 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390317.721382:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5000, rc 0) 00000100:00100000:3.0:1785390317.721424:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:14292:x1872116879319552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.721432:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1785390317.721714:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390317.721743:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0a7 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.721752:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ee0a7 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390317.721811:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.721839:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.721876:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390317.721987:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319680 00000100:00100000:3.0:1785390317.721992:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319680 00000100:00100000:3.0:1785390317.722016:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1785390317.722022:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:14292:x1872116879319680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390317.722420:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:14292:x1872116879319680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.722428:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1785390317.722491:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.722561:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.722608:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.722624:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390317.722718:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319808 00000100:00100000:3.0:1785390317.722723:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319808 00000100:00100000:3.0:1785390317.722751:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1785390317.722757:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:14292:x1872116879319808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390317.723054:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:14292:x1872116879319808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.723070:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1785390317.729735:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1785390317.738019:0:16369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1785390317.738256:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1785390317.738282:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785390317.738297:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0a7 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.738312:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf50121c400/0x33dffe75ff5ee0a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0a7 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1785390317.738324:0:14292:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1785390317.738327:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf503ea7800 from 10 10000000:01000000:2.0:1785390317.738331:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1785390317.738376:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.738385:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.738398:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390317.738427:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.738507:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.738581:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390317.739707:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879319936 00000100:00100000:3.0:1785390317.739718:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879319936 00000100:00100000:3.0:1785390317.739780:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1785390317.739790:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+17:14292:x1872116879319936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1785390317.739808:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390317.739824:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf535ef4600/0x33dffe75ff5ee0b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ee0ae expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390317.739854:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf535ef4600/0x33dffe75ff5ee0b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ee0ae expref: 18 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390317.739866:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf535ef4600/0x33dffe75ff5ee0b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ee0ae expref: 18 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390317.739876:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4600, rc 0) 00000100:00100000:3.0:1785390317.740064:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879319936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.740074:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1785390317.740180:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879319936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390317.740223:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0b5 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.740234:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ee0b5 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390317.740301:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.740331:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.740362:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390317.740460:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320064 00000100:00100000:3.0:1785390317.740465:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320064 00000100:00100000:3.0:1785390317.740494:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1785390317.740501:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53f41e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879320064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1785390317.740950:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53f41e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879320064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.740958:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1785390317.741048:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.741083:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.741126:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390317.741163:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390317.742022:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320192 00000100:00100000:3.0:1785390317.742028:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320192 00000100:00100000:3.0:1785390317.742071:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1785390317.742078:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879320192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1785390317.742797:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879320192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 717us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390317.742805:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1785390317.742885:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1785390317.759385:0:16370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1785390317.761698:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1785390317.761738:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1785390317.761753:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0b5 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.761769:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf50121c600/0x33dffe75ff5ee0ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0b5 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1785390317.761785:0:14292:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1785390317.761789:0:14292:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8cf5356ae000 from 10 10000000:01000000:0.0:1785390317.761792:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1785390317.761858:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.761868:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.761880:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390317.762367:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1785390317.762458:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390317.762515:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5238a2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390317.763014:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320320 00000100:00100000:2.0:1785390317.763024:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320320 00000100:00100000:2.0:1785390317.763080:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1785390317.763090:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+18:14292:x1872116879320320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1785390317.763108:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390317.763124:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee0c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33dffe75ff5ee0bc expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.763164:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee0c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33dffe75ff5ee0bc expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.763490:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf50121ca00/0x33dffe75ff5ee0c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33dffe75ff5ee0bc expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.763501:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121ca00, rc 0) 00000100:00100000:2.0:1785390317.763584:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879320320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 495us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390317.763593:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1785390317.764293:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1785390317.764313:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0c3 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390317.764324:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33dffe75ff5ee0c3 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390317.764403:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390317.764438:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390317.764474:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5238a2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390317.764549:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320448 00000100:00100000:2.0:1785390317.764554:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320448 00000100:00100000:2.0:1785390317.764581:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1785390317.764587:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879320448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.766281:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879320448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1687us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390317.766293:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1785390317.768764:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1785390317.768843:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1785390317.770015:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390317.770073:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5238a2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390317.770267:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320576 00000100:00100000:2.0:1785390317.770277:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320576 00000100:00100000:2.0:1785390317.770338:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785390317.770348:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879320576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1785390317.771830:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:14292:x1872116879320576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1477us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390317.771842:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1785390317.773012:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535ac3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:374ce4d4-733e-4fe2-9421-711e41cbfd01:14292:1872116879320576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1785390317.775998:0:16371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1785390317.778037:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1785390317.778074:0:14292:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1785390317.778088:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0c3 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390317.778117:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.154@tcp lock: ffff8cf503717800/0x33dffe75ff5ee0bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33dffe75ff5ee0c3 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390318.233393:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390319.253793:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390319.641089:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879320960:0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.641214:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390319.641279:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879321472:0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.641311:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390319.641346:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1785390319.641351:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879320832:0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.641378:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390319.641397:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879321344:0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.641415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390319.641441:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320960 00000100:00100000:1.0:1785390319.641450:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320960 00000100:00100000:1.0:1785390319.641511:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785390319.641519:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879320960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.641751:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879320960:12345-0@lo:400:kworker.0 Request processed in 231us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390319.641759:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1785390319.641786:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320832 00000100:00100000:1.0:1785390319.641789:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320832 00000100:00100000:1.0:1785390319.641811:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1785390319.641817:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3310:x1872116879320832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.641854:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3310:x1872116879320832:12345-0@lo:400:kworker.0 Request processed in 37us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390319.641860:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1785390319.642038:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:374ce4d4-733e-4fe2-9421-711e41cbfd01:3310:1872116879320832:0@lo:400:kworker.0 00000100:00100000:1.0:1785390319.642054:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879320960:0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.642216:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879320704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390319.642257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390319.642290:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879321216:0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.642323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390319.642348:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1785390319.642354:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879321088:0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.642375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390319.642411:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879321472 00000100:00100000:0.0:1785390319.642416:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879321472 00000100:00100000:0.0:1785390319.642442:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879321344 00000100:00100000:0.0:1785390319.642445:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879321344 00000100:00100000:0.0:1785390319.642459:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879321216 00000100:00100000:0.0:1785390319.642461:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879321216 00000100:00100000:0.0:1785390319.642474:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785390319.642481:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879321472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.642546:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1872116879321472:12345-0@lo:400:kworker.0 Request processed in 41us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390319.642554:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1785390319.642568:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785390319.642575:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879321344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1785390319.642769:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879320704 00000100:00100000:2.0:1785390319.642775:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879320704 00000100:00100000:2.0:1785390319.642809:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1785390319.642817:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879320704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390319.642866:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390319.642919:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879320704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390319.642926:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1785390319.643095:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1872116879321344:12345-0@lo:400:kworker.0 Request processed in 519us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390319.643102:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1785390319.643116:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1785390319.643134:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879321216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.643175:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879321216:12345-0@lo:400:kworker.0 Request processed in 42us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390319.643198:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1785390319.643223:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390319.643228:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1785390319.643230:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390319.643247:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879321088 00000100:00100000:0.0:1785390319.643251:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879321088 00000100:00100000:0.0:1785390319.643285:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785390319.643292:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879321088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.643428:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879321088:12345-0@lo:400:kworker.0 Request processed in 136us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390319.643437:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1785390319.643482:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879321088:0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.643501:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879320704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390319.643513:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879321216:0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.643750:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1872116879321344:0@lo:400:kworker.0 00000100:00100000:0.0:1785390319.643768:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535b12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1872116879321472:0@lo:400:kworker.0 00010000:00010000:2.0:1785390320.277988:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1785390321.303071:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390321.466103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390321.466228:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859328 00000100:00100000:0.0:1785390321.466240:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859328 00000100:00100000:0.0:1785390321.466329:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390321.466342:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:14400:x1872116847859328:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390321.466372:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390321.466403:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716e00/0x33dffe75ff5ee0ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3e6 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.466509:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.466559:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.466576:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.466591:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.466599:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.466606:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467088:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ee0df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467098:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ee0df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467118:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ee0df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390321.467206:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1785390321.467211:0:14296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1785390321.467315:0:14296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ee0df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467339:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467346:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467354:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467360:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390321.467366:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467375:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467391:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:0.0:1785390321.467394:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390321.467400:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467407:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee0d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467420:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467427:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467432:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467444:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390321.467447:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467454:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467462:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cf50896c600) 00010000:00010000:0.0:1785390321.467465:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390321.467467:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467473:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717a00/0x33dffe75ff5ee0d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467511:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716e00/0x33dffe75ff5ee0ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3e6 expref: 8 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467575:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717c00/0x33dffe75ff5ee0df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3e6 expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.467583:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf50896cc00) 00010000:00010000:0.0:1785390321.467586:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1785390321.467588:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717c00, rc 0) 00000100:00100000:0.0:1785390321.467665:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:14400:x1872116847859328:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1325us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.467673:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00080000:2.0:1785390321.468045:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390321.469883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.469988:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859584 00000100:00100000:2.0:1785390321.470000:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859584 00000100:00100000:2.0:1785390321.470062:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1785390321.470073:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:14400:x1872116847859584:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1785390321.470096:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390321.470131:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee0e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3ed expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.470215:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.470231:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.470265:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.470818:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.470842:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.470855:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471387:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d600/0x33dffe75ff5ee0fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471397:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d600/0x33dffe75ff5ee0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471404:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d600/0x33dffe75ff5ee0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390321.471416:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1785390321.471684:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471692:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471698:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471704:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121ce00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.471714:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471722:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471734:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf50896cc00) 00010000:00010000:2.0:1785390321.471737:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.471742:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471748:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee0ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471760:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471766:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471772:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471777:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.471780:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471786:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471794:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cf523a34200) 00010000:00010000:2.0:1785390321.471796:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.471804:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.471810:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee0f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.472189:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee0e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3ed expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.472204:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d600/0x33dffe75ff5ee0fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3ed expref: 9 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.472212:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf523a34800) 00010000:00010000:2.0:1785390321.472215:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.472217:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d600, rc 0) 00000100:00100000:2.0:1785390321.472287:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14400:x1872116847859584:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 2215us (2412us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1785390321.472297:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1785390321.479885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390321.479992:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859712 00000100:00100000:0.0:1785390321.480019:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859712 00000100:00100000:0.0:1785390321.480085:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:0.0:1785390321.480096:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14400:x1872116847859712:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1785390321.480247:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14400:x1872116847859712:12345-192.168.202.54@tcp:59:lhsmtool_posix.0 Request processed in 153us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.480256:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1785390321.553279:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.553441:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859840 00000100:00100000:2.0:1785390321.553454:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859840 00000100:00100000:2.0:1785390321.553555:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:2.0:1785390321.553567:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14406:x1872116847859840:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390321.553595:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390321.553621:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3f4 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.553710:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.553749:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.553763:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.553781:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.553789:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.553795:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554246:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554255:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554263:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554270:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.554274:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554282:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554295:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:2.0:1785390321.554357:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.554364:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554370:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554383:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554389:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554394:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554399:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121ce00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.554401:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554406:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554412:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf523a34200) 00010000:00010000:2.0:1785390321.554414:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.554416:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554420:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee117 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554455:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee109 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3f4 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554471:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:2.0:1785390321.554473:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.554477:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3f4 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.554485:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121cc00, rc 0) 00000100:00100000:3.0:1785390321.555984:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14406:x1872116847859840:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 2409us (2710us total) trans 0 rc 301/301 00000100:00100000:3.0:1785390321.555997:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:1.0:1785390321.570898:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390321.571053:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847859968 00000100:00100000:3.0:1785390321.571066:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847859968 00000100:00100000:3.0:1785390321.571192:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:3.0:1785390321.571205:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14406:x1872116847859968:12345-192.168.202.54@tcp:700:lfs.0 00000100:00100000:3.0:1785390321.571323:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14406:x1872116847859968:12345-192.168.202.54@tcp:700:lfs.0 Request processed in 122us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390321.571332:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:1.0:1785390321.579472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.579579:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860224 00000100:00100000:2.0:1785390321.579592:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860224 00000100:00100000:2.0:1785390321.579660:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1785390321.579671:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14406:x1872116847860224:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:2.0:1785390321.579751:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390321.579795:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5400/0x33dffe75ff5ee04c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c36f expref: 9 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.579829:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:2.0:1785390321.579836:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390321.580218:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.580236:0:14296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 5 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.580247:0:14296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.580288:0:14296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 5 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.580318:0:14296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 5 pid: 14297 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390321.580337:0:14296:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14296:1872116879321600:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390321.580462:0:14296:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf541cf8540 going to sleep for 11 seconds 00000100:00100000:1.0:1785390321.581624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390321.581656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390321.581681:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390321.581714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390321.581741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390321.581764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390321.581794:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860352 00000100:00100000:1.0:1785390321.581802:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860352 00000100:00100000:0.0:1785390321.582039:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860480 00000100:00100000:0.0:1785390321.582044:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860480 00000100:00100000:0.0:1785390321.582094:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860992 00000100:00100000:0.0:1785390321.582097:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860992 00000100:00100000:0.0:1785390321.582124:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860608 00000100:00100000:0.0:1785390321.582127:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860608 00000100:00100000:0.0:1785390321.582138:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860864 00000100:00100000:0.0:1785390321.582141:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860864 00000100:00100000:0.0:1785390321.582157:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1785390321.582165:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2358:x1872116847860480:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390321.582238:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2358:x1872116847860480:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.582248:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1785390321.582268:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1785390321.582275:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847860992:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390321.582312:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847860992:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 28us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.582319:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:0.0:1785390321.582331:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1785390321.582337:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2358:x1872116847860608:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390321.582375:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402232d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2358:x1872116847860608:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.582382:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:0.0:1785390321.582393:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1785390321.582399:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847860864:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:0.0:1785390321.582421:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847860864:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 23us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.582427:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00080000:0.0:1785390321.582444:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390321.582449:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390321.583734:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:1.0:1785390321.583743:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2358:x1872116847860352:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390321.583796:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2358:x1872116847860352:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 54us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390321.583803:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 125 00000100:00100000:3.0:1785390321.584331:0:14297:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1785390321.584341:0:14297:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1785390321.585785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390321.586322:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847861120 00000100:00100000:0.0:1785390321.586332:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847861120 00010000:00010000:0.0:1785390321.586391:0:14282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 6 pid: 14297 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390321.586423:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1785390321.586431:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2359:x1872116847861120:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390321.586446:0:14282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390321.586453:0:14282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 6 pid: 14297 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.586473:0:14282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 6 pid: 14297 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.586497:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:0.0:1785390321.586503:0:14282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.586547:0:14282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.586555:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.586576:0:14282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390321.586621:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2359:x1872116847861120:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 190us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390321.586628:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00080000:2.0:1785390321.587995:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1785390321.588232:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3d1 expref: 5 pid: 14297 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390321.588253:0:14296:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a890e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14296:1872116879321600:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390321.588277:0:14296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.588300:0:14296:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.588306:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.588334:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.588346:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.588355:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390321.589233:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847860736 00000100:00100000:2.0:1785390321.589241:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847860736 00000100:00100000:2.0:1785390321.589291:0:14297:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1785390321.589303:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:2.0:1785390321.589312:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf402230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847860736:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:2.0:1785390321.589383:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf402230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2358:x1872116847860736:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 73us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390321.589391:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000004:00200000:2.0:1785390321.604269:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785390321.604295:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.604654:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.604664:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.604671:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121cc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.604677:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.604701:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.604724:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf50629b000) 00010000:00010000:2.0:1785390321.604727:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.604734:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.604741:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee11e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390321.604768:0:14296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dbd437ba reply state 0000000070282f77 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390321.604780:0:14296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390321.605553:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535b13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+10:14406:x1872116847860224:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 25854us (26065us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1785390321.605564:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00010000:00010000:3.0:1785390321.616858:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.617018:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.617029:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.617036:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390321.617041:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.617051:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.617090:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf50629be00) 00010000:00010000:3.0:1785390321.617094:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390321.617099:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390321.617116:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee125 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390321.787064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.787182:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847861248 00000100:00100000:2.0:1785390321.787196:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847861248 00000100:00100000:2.0:1785390321.787267:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:2.0:1785390321.787278:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:14414:x1872116847861248:12345-192.168.202.54@tcp:101:lctl.0 00010000:00010000:2.0:1785390321.787322:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390321.787352:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee12c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c3fb expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.787435:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee133 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.787475:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.787488:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390321.787611:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785390321.787617:0:14297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390321.787665:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.787692:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee12c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3fb expref: 11 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.787713:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121ce00/0x33dffe75ff5ee133 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c3fb expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.787723:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:2.0:1785390321.787727:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390321.787730:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121ce00, rc 0) 00000100:00100000:2.0:1785390321.787807:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+10:14414:x1872116847861248:12345-192.168.202.54@tcp:101:lctl.0 Request processed in 530us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390321.787814:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:0.0:1785390321.868768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.868962:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847861376 00000100:00100000:2.0:1785390321.868975:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847861376 00000100:00100000:2.0:1785390321.869050:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:2.0:1785390321.869060:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:14415:x1872116847861376:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390321.869088:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390321.869139:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee13a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c402 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.869220:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee141 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.869236:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.869249:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390321.869417:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1785390321.869421:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390321.869449:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.869475:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee13a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c402 expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.869497:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c000/0x33dffe75ff5ee141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c402 expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.869506:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:2.0:1785390321.869509:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390321.869513:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c000, rc 0) 00000100:00100000:2.0:1785390321.869662:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:14415:x1872116847861376:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 602us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390321.869670:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1785390321.873428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.873649:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847861504 00000100:00100000:2.0:1785390321.873681:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847861504 00000100:00100000:2.0:1785390321.873753:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:2.0:1785390321.873765:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:14415:x1872116847861504:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390321.873793:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390321.873818:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c409 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.873909:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.873926:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.873939:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.873957:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.873966:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.873972:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874340:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee15d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874363:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee15d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874378:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee15d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390321.874462:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1785390321.874466:0:14297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390321.874489:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee15d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874502:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874509:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874516:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874522:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.874569:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874577:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874589:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:2.0:1785390321.874592:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.874597:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874604:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee14f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874621:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874637:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874644:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874648:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.874651:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874658:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874666:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf523a34700) 00010000:00010000:2.0:1785390321.874668:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390321.874671:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874676:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874715:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c409 expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874729:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee15d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c409 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.874736:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34100) 00010000:00010000:2.0:1785390321.874738:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390321.874746:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121de00, rc 0) 00000100:00100000:2.0:1785390321.874838:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+7:14415:x1872116847861504:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1073us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390321.874848:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:1.0:1785390321.893060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390321.893586:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847861760 00000100:00100000:0.0:1785390321.893602:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847861760 00000100:00100000:0.0:1785390321.893692:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:0.0:1785390321.893710:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+7:14415:x1872116847861760:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390321.893739:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390321.893766:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c410 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390321.893947:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1785390321.894110:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee164 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c410 expref: 9 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.894129:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:0.0:1785390321.894133:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785390321.894139:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c410 expref: 9 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.894181:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717600, rc 0) 00000100:00100000:0.0:1785390321.894254:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+8:14415:x1872116847861760:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 552us (1207us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1785390321.894263:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:1.0:1785390321.911807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.911935:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847862016 00000100:00100000:2.0:1785390321.911948:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847862016 00000100:00100000:2.0:1785390321.912020:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:2.0:1785390321.912032:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+8:14415:x1872116847862016:12345-192.168.202.54@tcp:36:lfs.0 00010000:00010000:2.0:1785390321.912114:0:16426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390321.912150:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee15d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c409 expref: 8 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.912175:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34100) 00010000:00010000:2.0:1785390321.912188:0:16426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390321.912217:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.912233:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.912244:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390321.912586:0:16426:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b4d942e reply state 00000000029d5dd3 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390321.912598:0:16426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1785390321.912614:0:16426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1785390321.912710:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+9:14415:x1872116847862016:12345-192.168.202.54@tcp:36:lfs.0 Request processed in 680us (916us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1785390321.912737:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00010000:00010000:2.0:1785390321.916880:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.916904:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.916913:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.916920:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390321.916925:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.916935:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.916951:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390321.916954:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1785390321.916959:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.916967:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee172 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390321.922513:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390321.922825:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847862272 00000100:00100000:3.0:1785390321.922838:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847862272 00000100:00100000:3.0:1785390321.922944:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:3.0:1785390321.922956:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+8:14415:x1872116847862272:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390321.924990:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+9:14415:x1872116847862272:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 340us (793us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1785390321.925005:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:1.0:1785390321.939443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390321.939579:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847862528 00000100:00100000:0.0:1785390321.939592:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847862528 00000100:00100000:0.0:1785390321.939660:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:0.0:1785390321.939671:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+9:14415:x1872116847862528:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:0.0:1785390321.939702:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390321.939728:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c417 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.939821:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.939839:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.939855:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.939883:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.939891:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.939899:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390321.940084:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1785390321.940217:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940226:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940234:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940241:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390321.940246:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940255:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940268:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:0.0:1785390321.940271:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390321.940276:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940282:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940311:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940318:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940335:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940341:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390321.940344:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940350:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940359:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf50896c600) 00010000:00010000:0.0:1785390321.940361:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390321.940364:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940369:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee187 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940414:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee179 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c417 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940425:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:0.0:1785390321.940427:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1785390321.940431:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c417 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390321.940441:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717600, rc 0) 00000100:00100000:0.0:1785390321.940517:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+10:14415:x1872116847862528:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 846us (1087us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1785390321.940590:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785390321.962794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390321.962909:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847862656 00000100:00100000:2.0:1785390321.962922:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847862656 00000100:00100000:2.0:1785390321.962991:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:2.0:1785390321.963002:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+10:14415:x1872116847862656:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390321.963035:0:16426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390321.963082:0:16426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee195 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c41e expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.963223:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.963240:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.963253:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390321.963329:0:16426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1785390321.963334:0:16426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390321.963356:0:16426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.963385:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee195 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 12 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.963406:0:16426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 11 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390321.963415:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390321.963419:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1785390321.963423:0:16426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121de00, rc 0) 00000100:00100000:2.0:1785390321.963495:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+11:14415:x1872116847862656:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 495us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390321.963502:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1785390321.966947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390321.967035:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847862784 00000100:00100000:0.0:1785390321.967047:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847862784 00000100:00100000:0.0:1785390321.967115:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:0.0:1785390321.967127:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+11:14415:x1872116847862784:12345-192.168.202.54@tcp:37:lfs.0 00000100:00100000:1.0:1785390321.978580:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+11:14415:x1872116847862784:12345-192.168.202.54@tcp:37:lfs.0 Request processed in 11436us (11626us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390321.978598:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 3 00000100:00100000:1.0:1785390321.994779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390321.995123:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847863040 00000100:00100000:3.0:1785390321.995137:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847863040 00000100:00100000:3.0:1785390321.995211:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:3.0:1785390321.995225:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f358850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+11:14415:x1872116847863040:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:3.0:1785390321.995640:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f358850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+12:14415:x1872116847863040:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 418us (875us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1785390321.995649:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 4 00000100:00100000:0.0:1785390322.139013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390322.139133:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847863168 00000100:00100000:2.0:1785390322.139159:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847863168 00000100:00100000:2.0:1785390322.139234:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:2.0:1785390322.139246:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+10:14421:x1872116847863168:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390322.139273:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390322.139309:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c425 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139394:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139412:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139426:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139442:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139450:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139456:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139632:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee1b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139641:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139648:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390322.139691:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1785390322.139694:0:14296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390322.139739:0:14296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139753:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139760:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139767:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139773:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390322.139777:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139786:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139800:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:2.0:1785390322.139803:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390322.139808:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139814:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139829:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139845:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139852:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139857:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390322.139860:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139866:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139874:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf523a34100) 00010000:00010000:2.0:1785390322.139877:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390322.139879:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139884:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139919:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c425 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139934:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121cc00/0x33dffe75ff5ee1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c425 expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.139943:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390322.139945:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1785390322.139955:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121cc00, rc 0) 00000100:00100000:2.0:1785390322.140033:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+11:14421:x1872116847863168:12345-192.168.202.54@tcp:101:bash.0 Request processed in 789us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390322.140041:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 27 00000100:00100000:0.0:1785390322.160011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390322.160178:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847863424 00000100:00100000:2.0:1785390322.160192:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847863424 00000100:00100000:2.0:1785390322.160272:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 28 00000100:00100000:2.0:1785390322.160300:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+11:14421:x1872116847863424:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390322.160332:0:16426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390322.160360:0:16426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1bf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c42c expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.160575:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.160592:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 11 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.160601:0:16426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.160645:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 11 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.160661:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 11 pid: 16426 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390322.160677:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879321728:192.168.202.54@tcp:104: 00000100:00100000:2.0:1785390322.160812:0:16426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf541cf8840 going to sleep for 11 seconds 00000100:00100000:1.0:1785390322.180923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390322.181255:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847863552 00000100:00100000:0.0:1785390322.181268:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847863552 00010000:00010000:0.0:1785390322.181329:0:16315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 12 pid: 16426 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390322.181380:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1785390322.181390:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+12:2359:x1872116847863552:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390322.181411:0:16315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390322.181419:0:16315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 12 pid: 16426 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390322.181434:0:16315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 12 pid: 16426 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390322.181459:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:0.0:1785390322.181465:0:16315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390322.181476:0:16315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390322.181501:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390322.181563:0:16315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390322.181628:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+12:2359:x1872116847863552:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 238us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390322.181643:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00010000:00010000:2.0:1785390322.182259:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee19c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c41e expref: 11 pid: 16426 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390322.182280:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879321728:192.168.202.54@tcp:104: 00010000:00010000:2.0:1785390322.182316:0:16426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.182327:0:16426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.182334:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.182361:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.182372:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.182380:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.184934:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.184956:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.184969:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390322.185006:0:16426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1785390322.185059:0:16426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.185066:0:16426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.185071:0:16426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.185077:0:16426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390322.185081:0:16426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.185088:0:16426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.185112:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390322.185115:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390322.185120:0:16426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.185126:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390322.185143:0:16426:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000733cb08a reply state 0000000082a79a3c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390322.185152:0:16426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1785390322.185707:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 14 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.186836:0:16426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 13 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.186848:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390322.186851:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1785390322.186854:0:16426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c200, rc 0) 00000100:00100000:2.0:1785390322.186947:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+14:14421:x1872116847863424:12345-192.168.202.54@tcp:101:bash.0 Request processed in 26656us (26949us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1785390322.186956:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 28 00000040:00080000:3.0:1785390322.198586:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1785390322.199498:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1785390322.199521:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879321856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1785390322.199622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390322.199677:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879321856 00000100:00100000:1.0:1785390322.199685:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879321856 00000100:00100000:1.0:1785390322.199745:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1785390322.199754:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879321856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1785390322.199802:0:14936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1785390322.199854:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879321856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00080000:0.0:1785390322.199965:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1785390322.200024:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1785390322.200055:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879321856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1785390322.202404:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390322.202446:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390322.202454:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390322.202460:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390322.202466:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390322.202474:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390322.202494:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cf523a34100) 00010000:00010000:3.0:1785390322.202498:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390322.202503:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390322.202510:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee1cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390322.225281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390322.225374:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847863680 00000100:00100000:2.0:1785390322.225385:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847863680 00000100:00100000:2.0:1785390322.225438:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:2.0:1785390322.225447:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14421:x1872116847863680:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390322.225472:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390322.225494:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c433 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225592:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225607:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225619:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390322.225660:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785390322.225682:0:14296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390322.225704:0:14296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225716:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225754:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c433 expref: 15 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225782:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c433 expref: 14 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.225792:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390322.225794:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390322.225798:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121c800, rc 0) 00000100:00100000:2.0:1785390322.225863:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+14:14421:x1872116847863680:12345-192.168.202.54@tcp:101:bash.0 Request processed in 416us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390322.225870:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 29 00000100:00100000:1.0:1785390322.236271:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390322.236352:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847863936 00000100:00100000:3.0:1785390322.236362:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847863936 00000100:00100000:3.0:1785390322.236415:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 5 00000100:00100000:3.0:1785390322.236426:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+14:14421:x1872116847863936:12345-192.168.202.54@tcp:35:bash.0 00000100:00100000:3.0:1785390322.236823:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+15:14421:x1872116847863936:12345-192.168.202.54@tcp:35:bash.0 Request processed in 397us (559us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1785390322.236832:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 5 00010000:00010000:2.0:1785390322.325813:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1785390322.353634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390322.358227:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847864192 00000100:00100000:3.0:1785390322.358268:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847864192 00000100:00100000:2.0:1785390322.370396:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:2.0:1785390322.370418:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+15:14431:x1872116847864192:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390322.370451:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390322.370480:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c43a expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390322.370642:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1785390322.370796:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c43a expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.370835:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:2.0:1785390322.370838:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785390322.370851:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c43a expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.371274:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d200, rc 0) 00000100:00100000:2.0:1785390322.371624:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+16:14431:x1872116847864192:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1214us (18004us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1785390322.371633:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 30 00000100:00100000:0.0:1785390322.376983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390322.377134:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847864448 00000100:00100000:1.0:1785390322.377146:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847864448 00000100:00100000:1.0:1785390322.377211:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1785390322.377221:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+16:14431:x1872116847864448:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390322.377587:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:14431:x1872116847864448:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 366us (617us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1785390322.377596:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 6 00000100:00100000:1.0:1785390322.503661:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390322.504924:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847864704 00000100:00100000:2.0:1785390322.504939:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847864704 00000100:00100000:2.0:1785390322.505018:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1785390322.505030:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:14434:x1872116847864704:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390322.505061:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390322.505087:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c441 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.505224:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee205 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.505240:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.505255:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390322.505267:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1785390322.505595:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee1fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c441 expref: 20 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.505618:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee205 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c441 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390322.505628:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390322.505631:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390322.505634:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121dc00, rc 0) 00000100:00100000:2.0:1785390322.505698:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14434:x1872116847864704:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 671us (2049us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1785390322.505706:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 31 00000100:00100000:2.0:1785390322.511885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390322.515453:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847864832 00000100:00100000:0.0:1785390322.515471:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847864832 00000100:00100000:0.0:1785390322.515613:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1785390322.515625:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:2357:x1872116847864832:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390322.515645:0:14282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390322.515676:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee205 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c441 expref: 19 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390322.515702:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:0.0:1785390322.515708:0:14282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390322.515797:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:2357:x1872116847864832:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 174us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390322.515805:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1785390322.526747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390322.528003:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847864960 00000100:00100000:1.0:1785390322.528020:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847864960 00000100:00100000:1.0:1785390322.528116:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:1.0:1785390322.528129:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:14434:x1872116847864960:12345-192.168.202.54@tcp:54:lfs.0 00010000:00010000:1.0:1785390322.528227:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528248:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528263:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528299:0:16426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528329:0:16426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528338:0:16426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528344:0:16426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4400 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390322.528349:0:16426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528357:0:16426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528372:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:1.0:1785390322.528375:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390322.528381:0:16426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390322.528387:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee213 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390322.528487:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:14434:x1872116847864960:12345-192.168.202.54@tcp:54:lfs.0 Request processed in 361us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390322.528496:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 32 00000100:00100000:2.0:1785390322.535104:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390322.535188:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847865216 00000100:00100000:1.0:1785390322.535200:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847865216 00000100:00100000:1.0:1785390322.535264:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 7 00000100:00100000:1.0:1785390322.535282:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:14434:x1872116847865216:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390322.535733:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14434:x1872116847865216:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 452us (650us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1785390322.535757:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 7 00000001:00080000:1.0:1785390322.803484:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1785390322.804027:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:1.0:1785390322.804066:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1785390323.117336:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390323.119852:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847865472 00000100:00100000:0.0:1785390323.119870:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847865472 00000100:00100000:0.0:1785390323.120000:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00100000:0.0:1785390323.120015:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+11:14465:x1872116847865472:12345-192.168.202.54@tcp:101:cat.0 00010000:00010000:0.0:1785390323.120047:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390323.120083:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee21a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c448 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390323.120221:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee221 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390323.120239:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390323.120253:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1785390323.120266:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1785390323.120496:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee21a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c448 expref: 14 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390323.120519:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c448 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390323.120580:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:0.0:1785390323.120583:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390323.120587:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503717200, rc 0) 00000100:00100000:0.0:1785390323.120667:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14465:x1872116847865472:12345-192.168.202.54@tcp:101:cat.0 Request processed in 657us (3345us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1785390323.120676:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 33 00000100:00080000:2.0:1785390323.120993:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1785390323.139786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390323.139898:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390323.140022:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847865728 00000100:00100000:1.0:1785390323.140037:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847865728 00000100:00100000:1.0:1785390323.140118:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:1.0:1785390323.140130:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14465:x1872116847865728:12345-192.168.202.54@tcp:35:cat.0 00000100:00100000:1.0:1785390323.140629:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+14:14465:x1872116847865728:12345-192.168.202.54@tcp:35:cat.0 Request processed in 499us (856us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1785390323.140638:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 8 00000100:00100000:2.0:1785390323.140886:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847865856 00000100:00100000:2.0:1785390323.140892:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847865856 00000100:00100000:2.0:1785390323.140943:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:2.0:1785390323.140951:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+14:2357:x1872116847865856:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390323.140965:0:16315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390323.140993:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717200/0x33dffe75ff5ee221 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c448 expref: 14 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.141014:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390323.141020:0:16315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390323.141043:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:2357:x1872116847865856:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 93us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390323.141064:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 1 00000100:00100000:0.0:1785390323.317351:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390323.317425:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847866112 00000100:00100000:2.0:1785390323.317438:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847866112 00000100:00100000:2.0:1785390323.317511:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:2.0:1785390323.317555:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14471:x1872116847866112:12345-192.168.202.54@tcp:101:dd.0 00010000:00010000:2.0:1785390323.317590:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390323.317618:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee22f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c44f expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.317747:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee236 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.317763:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.317776:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390323.317788:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1785390323.317976:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee22f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c44f expref: 16 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.317996:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c44f expref: 15 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.318006:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390323.318010:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390323.318013:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d200, rc 0) 00000100:00100000:2.0:1785390323.318105:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+15:14471:x1872116847866112:12345-192.168.202.54@tcp:101:dd.0 Request processed in 584us (766us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1785390323.318113:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 34 00000100:00100000:0.0:1785390323.337476:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390323.337611:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847866368 00000100:00100000:3.0:1785390323.337624:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847866368 00000100:00100000:3.0:1785390323.337695:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 35 00000100:00100000:3.0:1785390323.337705:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+15:14471:x1872116847866368:12345-192.168.202.54@tcp:36:dd.0 00010000:00010000:3.0:1785390323.337781:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1785390323.337813:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee236 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c44f expref: 15 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.337837:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee1e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c433 expref: 14 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.337859:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:3.0:1785390323.337865:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390323.338139:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.338154:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.338163:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390323.338233:0:14295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1785390323.338272:0:14295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007eb24dd6 reply state 000000008f2a1f29 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390323.338292:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390323.338397:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+16:14471:x1872116847866368:12345-192.168.202.54@tcp:36:dd.0 Request processed in 693us (934us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1785390323.338423:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 35 00000020:00080000:3.0:1785390323.338428:0:14295:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785390323.340134:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.340151:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.340160:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.340167:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef4e00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390323.340173:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.340182:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.340200:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390323.340203:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390323.340209:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.340216:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4e00/0x33dffe75ff5ee244 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.351566:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390323.514938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390323.515050:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847866624 00000100:00100000:1.0:1785390323.515063:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847866624 00000100:00100000:1.0:1785390323.515139:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:1.0:1785390323.515151:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+15:14471:x1872116847866624:12345-192.168.202.54@tcp:35:dd.0 00000100:00100000:1.0:1785390323.515613:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+16:14471:x1872116847866624:12345-192.168.202.54@tcp:35:dd.0 Request processed in 463us (688us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1785390323.515622:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 9 00000100:00100000:0.0:1785390323.845783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390323.845914:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847866752 00000100:00100000:2.0:1785390323.845927:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847866752 00000100:00100000:2.0:1785390323.845997:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:2.0:1785390323.846007:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+16:14485:x1872116847866752:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:2.0:1785390323.846057:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390323.846082:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee24b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c456 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846204:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846221:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846236:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846255:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846262:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846270:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846755:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846764:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846771:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390323.846814:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785390323.846824:0:14297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390323.846889:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846904:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846914:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846921:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846929:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846936:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390323.846941:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846950:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846964:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390323.846967:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390323.846972:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846980:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee252 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.846993:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847010:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847016:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847021:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390323.847024:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847031:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847039:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cf523a34e00) 00010000:00010000:2.0:1785390323.847042:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390323.847045:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847052:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee259 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847096:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee24b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c456 expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847112:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c456 expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390323.847120:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390323.847123:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390323.847131:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d000, rc 0) 00000100:00100000:2.0:1785390323.847207:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:14485:x1872116847866752:12345-192.168.202.54@tcp:101:stat.0 Request processed in 1200us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390323.847216:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 36 00000100:00100000:0.0:1785390323.971509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390323.971756:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847867008 00000100:00100000:3.0:1785390323.971770:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847867008 00000100:00100000:3.0:1785390323.971852:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1785390323.971864:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:14491:x1872116847867008:12345-192.168.202.54@tcp:36:truncate.0 00010000:00010000:3.0:1785390323.971940:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390323.971977:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee260 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c456 expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.972003:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:3.0:1785390323.972009:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390323.972331:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.972347:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.972357:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390323.972415:0:14295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1785390323.972458:0:14295:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000778b6073 reply state 00000000f13d97d1 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390323.972469:0:14295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1785390323.972667:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14491:x1872116847867008:12345-192.168.202.54@tcp:36:truncate.0 Request processed in 804us (1172us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1785390323.972696:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000020:00080000:3.0:1785390323.972703:0:14295:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1785390323.975250:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.975273:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.975282:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.975288:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf535ef5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390323.975294:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.975302:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.975320:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:3.0:1785390323.975324:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1785390323.975328:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390323.975336:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee267 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390324.247311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390324.248151:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847867136 00000100:00100000:2.0:1785390324.248165:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847867136 00000100:00100000:2.0:1785390324.248243:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:2.0:1785390324.248255:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:14505:x1872116847867136:12345-192.168.202.54@tcp:101:stat.0 00010000:00010000:2.0:1785390324.248286:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390324.248315:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee26e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c45d expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248400:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248416:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248430:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248447:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248454:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248462:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248878:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248894:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248901:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390324.248944:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1785390324.248949:0:14297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390324.248970:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248982:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248992:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.248999:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249006:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249012:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390324.249017:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249025:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249039:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390324.249049:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390324.249055:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249062:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee275 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249075:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249092:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249098:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249103:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390324.249107:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249113:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249120:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cf523a34e00) 00010000:00010000:2.0:1785390324.249122:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390324.249125:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249131:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee27c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249164:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee26e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 20 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249189:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.249197:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390324.249199:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1785390324.249202:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121d000, rc 0) 00000100:00100000:2.0:1785390324.249283:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14505:x1872116847867136:12345-192.168.202.54@tcp:101:stat.0 Request processed in 1031us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390324.249292:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00010000:00010000:2.0:1785390324.374226:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390324.389614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390324.390069:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847867392 00000100:00100000:3.0:1785390324.390113:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847867392 00000100:00100000:3.0:1785390324.390435:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:3.0:1785390324.390449:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14516:x1872116847867392:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:3.0:1785390324.390499:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390324.390557:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee28a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c464 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390324.391192:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1785390324.392187:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee28a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c464 expref: 21 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.392205:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:3.0:1785390324.392208:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1785390324.392214:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee28a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c464 expref: 21 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.392230:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5c00, rc 0) 00000100:00100000:3.0:1785390324.392471:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+20:14516:x1872116847867392:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 2024us (2869us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1785390324.392480:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 39 00000100:00100000:0.0:1785390324.411450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390324.411558:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847867648 00000100:00100000:1.0:1785390324.411571:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847867648 00000100:00100000:1.0:1785390324.411640:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:1.0:1785390324.411651:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf51f35b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+20:14516:x1872116847867648:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:1.0:1785390324.413018:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf51f35b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+21:14516:x1872116847867648:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 1363us (1577us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1785390324.413030:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 10 00000100:00100000:0.0:1785390324.549074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390324.549237:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847867904 00000100:00100000:1.0:1785390324.549250:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847867904 00000100:00100000:1.0:1785390324.549327:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:1.0:1785390324.549339:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+21:14522:x1872116847867904:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1785390324.549372:0:16426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390324.549400:0:16426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee298 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c46b expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549582:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549601:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 22 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549610:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 22 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549619:0:16426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549659:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 22 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549674:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 22 pid: 14297 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390324.549691:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879321984:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390324.549807:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 22 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.549935:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 22 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390324.549945:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879322112:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390324.549975:0:16426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf53b78da80 going to sleep for 11 seconds 00000100:00100000:2.0:1785390324.574494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390324.574573:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390324.574775:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847868032 00000100:00100000:0.0:1785390324.574794:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847868032 00010000:00010000:0.0:1785390324.574965:0:14282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 23 pid: 14297 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390324.575011:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847868160 00000100:00100000:0.0:1785390324.575015:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847868160 00010000:00010000:0.0:1785390324.575030:0:14282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 24 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390324.575056:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:0.0:1785390324.575066:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:2359:x1872116847868032:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390324.575093:0:14282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390324.575103:0:14282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 24 pid: 14297 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390324.575117:0:14282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 24 pid: 14297 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390324.575174:0:14282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:0.0:1785390324.575180:0:14282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390324.575189:0:14282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390324.575196:0:14282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390324.575261:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:2359:x1872116847868032:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 195us (781us total) trans 0 rc 0/0 00010000:00010000:1.0:1785390324.575434:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee283 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c45d expref: 24 pid: 14297 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390324.575453:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879321984:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390324.575463:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879322112:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390324.575490:0:16426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390324.575640:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:3.0:1785390324.587624:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1785390324.587661:0:14281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:2359:x1872116847868160:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1785390324.587688:0:14281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1785390324.587703:0:14281:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 22 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.587726:0:14281:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 22 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.587757:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c200/0x33dffe75ff5ee1d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c42c expref: 22 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.587798:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:3.0:1785390324.587805:0:14281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.587816:0:14281:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.587920:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.588101:0:14281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1785390324.588297:0:14281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+21:2359:x1872116847868160:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 655us (13721us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390324.588307:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00010000:00010000:3.0:1785390324.588408:0:16426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.588417:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390324.588993:0:16426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1785390324.589202:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee298 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 22 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.589225:0:16426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 21 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.589235:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:3.0:1785390324.589246:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1785390324.589249:0:16426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5400, rc 0) 00000100:00100000:3.0:1785390324.589283:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+21:14522:x1872116847867904:12345-192.168.202.54@tcp:101:bash.0 Request processed in 39947us (40224us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1785390324.589291:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 40 00000100:00100000:3.0:1785390324.603263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390324.603428:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847868416 00000100:00100000:1.0:1785390324.603441:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847868416 00000100:00100000:1.0:1785390324.603510:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 41 00000100:00100000:1.0:1785390324.603522:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+21:14522:x1872116847868416:12345-192.168.202.54@tcp:36:bash.0 00010000:00010000:1.0:1785390324.603948:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.603970:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.603984:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1785390324.604063:0:14296:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1785390324.604100:0:14296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be7269ae reply state 00000000771f1da1 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390324.604111:0:14296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390324.604230:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14522:x1872116847868416:12345-192.168.202.54@tcp:36:bash.0 Request processed in 709us (980us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1785390324.604238:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 41 00000020:00080000:1.0:1785390324.604243:0:14296:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1785390324.608437:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.608459:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.608467:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.608474:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390324.608480:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.608488:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.608508:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390324.608553:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390324.608560:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.608567:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee2ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390324.614266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390324.614516:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847868544 00000100:00100000:2.0:1785390324.614569:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847868544 00000100:00100000:2.0:1785390324.614643:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:2.0:1785390324.614655:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14522:x1872116847868544:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:2.0:1785390324.614690:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390324.614717:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c472 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.614793:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c472 expref: 24 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.614811:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c472 expref: 24 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.614834:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390324.614837:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1785390324.614854:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121dc00, rc 0) 00000100:00100000:2.0:1785390324.614927:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14522:x1872116847868544:12345-192.168.202.54@tcp:101:bash.0 Request processed in 273us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390324.614935:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 42 00000100:00100000:1.0:1785390324.649618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390324.649708:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847868672 00000100:00100000:3.0:1785390324.649722:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847868672 00000100:00100000:3.0:1785390324.649788:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:3.0:1785390324.649800:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14522:x1872116847868672:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390324.649831:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390324.649858:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee2bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c479 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.649988:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.650006:0:14295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 25 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.650017:0:14295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.650064:0:14295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 25 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.650091:0:14295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 25 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1785390324.650133:0:14295:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14295:1872116879322240:192.168.202.54@tcp:104: 00000100:00100000:3.0:1785390324.650245:0:14295:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf510b6e480 going to sleep for 11 seconds 00000100:00100000:0.0:1785390324.652288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390324.652588:0:14295:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc02d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14295:1872116879322240:192.168.202.54@tcp:104: 00010000:00010000:3.0:1785390324.652620:0:14295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390324.657035:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847868800 00000100:00100000:1.0:1785390324.657054:0:14281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847868800 00010000:00010000:1.0:1785390324.657124:0:14281:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 26 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390324.657244:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:1.0:1785390324.657255:0:14281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+26:2360:x1872116847868800:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390324.657282:0:14281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390324.657291:0:14281:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 26 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.657307:0:14281:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 26 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.657335:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee29f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c46b expref: 26 pid: 16426 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.657379:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:1.0:1785390324.657386:0:14281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.657396:0:14281:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.657405:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.657439:0:14281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1785390324.657505:0:14281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+25:2360:x1872116847868800:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 251us (5225us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390324.657512:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00010000:00010000:3.0:1785390324.657609:0:14295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.657618:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1785390324.657676:0:14295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1785390324.657681:0:14295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1785390324.657705:0:14295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.657740:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef5c00/0x33dffe75ff5ee2bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c479 expref: 25 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.657756:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c479 expref: 24 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390324.657764:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:3.0:1785390324.657767:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1785390324.657769:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef4c00, rc 0) 00000100:00100000:3.0:1785390324.657798:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14522:x1872116847868672:12345-192.168.202.54@tcp:101:bash.0 Request processed in 8001us (8195us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390324.657812:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 43 00000100:00100000:0.0:1785390324.665042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390324.671652:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869056 00000100:00100000:2.0:1785390324.671673:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869056 00000100:00100000:2.0:1785390324.671785:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:2.0:1785390324.671796:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14522:x1872116847869056:12345-192.168.202.54@tcp:103:bash.0 00010000:00010000:2.0:1785390324.671816:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1785390324.671932:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf535ef4c00/0x33dffe75ff5ee2c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c479 expref: 24 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.671963:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c472 expref: 23 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.671975:0:14280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390324.671989:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1785390324.672173:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:14522:x1872116847869056:12345-192.168.202.54@tcp:103:bash.0 Request processed in 378us (7143us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390324.672183:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 2 00000100:00100000:0.0:1785390324.684463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390324.689416:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869184 00000100:00100000:2.0:1785390324.689435:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869184 00000100:00100000:2.0:1785390324.689537:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1785390324.689548:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:14522:x1872116847869184:12345-192.168.202.54@tcp:58:bash.0 00010000:00010000:2.0:1785390324.689680:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.689701:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390324.689716:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1785390324.692658:0:14297:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1785390324.694031:0:14297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1785390324.694202:0:14297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1785390324.695551:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:14522:x1872116847869184:12345-192.168.202.54@tcp:58:bash.0 Request processed in 5971us (11070us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390324.695567:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 44 00000100:00100000:2.0:1785390324.713515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390324.714397:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869312 00000100:00100000:1.0:1785390324.714410:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869312 00000100:00100000:1.0:1785390324.714548:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:1.0:1785390324.714560:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:14522:x1872116847869312:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:1.0:1785390324.714587:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390324.714614:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c480 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.714685:0:14296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.714698:0:14296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 23 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.714741:0:14296:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.714754:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 23 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.714768:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:1.0:1785390324.714771:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390324.714775:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 23 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390324.714783:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5400, rc 0) 00000100:00100000:1.0:1785390324.714859:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14522:x1872116847869312:12345-192.168.202.54@tcp:101:bash.0 Request processed in 301us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390324.714868:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 45 00000100:00100000:0.0:1785390324.757941:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879322496:0@lo:400:kworker.0 00000100:00100000:0.0:1785390324.758036:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390324.758115:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879323008:0@lo:400:kworker.0 00000100:00100000:0.0:1785390324.758145:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390324.758178:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1785390324.758185:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879322624:0@lo:400:kworker.0 00000100:00100000:0.0:1785390324.758209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390324.758257:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879322496 00000100:00100000:0.0:1785390324.758265:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879322496 00000100:00100000:0.0:1785390324.758339:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879322624 00000100:00100000:0.0:1785390324.758342:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879322624 00000100:00100000:0.0:1785390324.758363:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785390324.758372:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879322496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390324.758449:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879322496:12345-0@lo:400:kworker.0 Request processed in 77us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390324.758457:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1785390324.758477:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1785390324.758484:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879322624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1785390324.758509:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879322624:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390324.758515:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1785390324.758555:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1785390324.758560:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1785390324.758593:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879322624:0@lo:400:kworker.0 00000100:00100000:0.0:1785390324.758602:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879322496:0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.758871:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879322368:0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.758911:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390324.758939:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879322880:0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.758963:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390324.758982:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1785390324.758988:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879322752:0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.759012:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390324.759045:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879322368 00000100:00100000:3.0:1785390324.759048:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879322368 00000100:00100000:3.0:1785390324.759092:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1785390324.759100:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3308:x1872116879322368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.759136:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3308:x1872116879322368:12345-0@lo:400:kworker.0 Request processed in 37us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390324.759142:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1785390324.759177:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:374ce4d4-733e-4fe2-9421-711e41cbfd01:3308:1872116879322368:0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.759194:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879323008 00000100:00100000:3.0:1785390324.759197:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879323008 00000100:00100000:3.0:1785390324.759228:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879322880 00000100:00100000:3.0:1785390324.759230:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879322880 00000100:00100000:3.0:1785390324.759241:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879322752 00000100:00100000:3.0:1785390324.759243:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879322752 00000100:00100000:3.0:1785390324.759254:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785390324.759259:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879323008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390324.759485:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785390324.759495:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879322880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390324.759554:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1872116879322880:12345-0@lo:400:kworker.0 Request processed in 61us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390324.759561:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1785390324.759573:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1785390324.759578:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390324.759602:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879322752:12345-0@lo:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390324.759608:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1785390324.759647:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390324.759733:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879323008:12345-0@lo:400:kworker.0 Request processed in 473us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390324.759746:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1785390324.759772:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879322752:0@lo:400:kworker.0 00000100:00100000:3.0:1785390324.759781:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1872116879322880:0@lo:400:kworker.0 00000100:00100000:1.0:1785390324.759868:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879323008:0@lo:400:kworker.0 00000100:00100000:1.0:1785390324.760091:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879323136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1785390324.760124:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1785390324.760193:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879323136 00000100:00100000:2.0:1785390324.760199:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879323136 00000100:00100000:2.0:1785390324.760233:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785390324.760240:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879323136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1785390324.760282:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1785390324.760324:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1872116879323136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390324.760331:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1785390324.760361:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1872116879323136:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1785390325.270484:0:14329:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1785390325.270497:0:14329:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390325.270573:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1785390325.270581:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1785390325.270743:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14329:1872116879323264:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1785390325.273062:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf541cf86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1785390325.286418:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.288248:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869440 00000100:00100000:0.0:1785390325.288272:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869440 00000100:00100000:0.0:1785390325.288356:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1785390325.288367:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14523:x1872116847869440:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1785390325.288468:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14523:x1872116847869440:12345-192.168.202.54@tcp:900:lhsmtool_posix.0 Request processed in 103us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390325.288477:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00080000:1.0:1785390325.288623:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390325.294819:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53a892a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14329:1872116879323264:192.168.202.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1785390325.302012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.311927:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869568 00000100:00100000:1.0:1785390325.311946:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869568 00000100:00100000:1.0:1785390325.317087:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:1.0:1785390325.317127:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14523:x1872116847869568:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785390325.317178:0:14295:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785390325.317353:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14523:x1872116847869568:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 250us (15355us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.317361:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 46 00000100:00100000:0.0:1785390325.332567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390325.333446:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869696 00000100:00100000:2.0:1785390325.333460:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869696 00000100:00100000:2.0:1785390325.333559:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:2.0:1785390325.333571:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14523:x1872116847869696:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1785390325.336140:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336186:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336200:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336223:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336231:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336238:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336282:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336291:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336297:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390325.336350:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1785390325.336355:0:14296:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1785390325.336372:0:14296:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336383:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336400:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336407:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336518:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390325.336546:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336556:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336571:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf523a34800) 00010000:00010000:2.0:1785390325.336574:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390325.336580:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336586:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee2d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336601:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336606:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336612:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336618:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390325.336629:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336635:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336643:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cf523a34e00) 00010000:00010000:2.0:1785390325.336645:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390325.336648:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336653:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee2de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336670:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336675:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336680:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336684:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390325.336687:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336692:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336698:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390325.336700:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390325.336709:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.336715:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee2e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.336962:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14523:x1872116847869696:12345-192.168.202.54@tcp:34:lhsmtool_posix.0 Request processed in 3387us (4403us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390325.336972:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 47 00000100:00100000:2.0:1785390325.343488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.343687:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847869952 00000100:00100000:1.0:1785390325.343701:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847869952 00000100:00100000:1.0:1785390325.343783:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:1.0:1785390325.343795:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14523:x1872116847869952:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.343824:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390325.344104:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee2ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c487 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.344241:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.344261:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.344284:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390325.344313:0:14297:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1785390325.345199:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345210:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345216:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345223:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5a00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:1.0:1785390325.345228:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345237:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345251:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:1.0:1785390325.345254:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1785390325.345269:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345276:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee2f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345334:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee2ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c487 expref: 25 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345346:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf523a34800) 00010000:00010000:1.0:1785390325.345348:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1785390325.345359:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee2ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c487 expref: 25 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.345369:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5c00, rc 0) 00000100:00100000:1.0:1785390325.345447:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14523:x1872116847869952:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 1653us (1980us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1785390325.345456:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 48 00000100:00100000:0.0:1785390325.353997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.354109:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847870080 00000100:00100000:1.0:1785390325.354123:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847870080 00000100:00100000:1.0:1785390325.354200:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:1.0:1785390325.354211:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14523:x1872116847870080:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1785390325.354259:0:14295:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1785390325.354398:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14523:x1872116847870080:12345-192.168.202.54@tcp:53:lhsmtool_posix.0 Request processed in 189us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.354406:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 49 00000100:00100000:2.0:1785390325.358854:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.359560:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847870336 00000100:00100000:0.0:1785390325.359573:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847870336 00000100:00100000:0.0:1785390325.359641:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:0.0:1785390325.359651:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14523:x1872116847870336:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390325.359707:0:16426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390325.359734:0:16426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee301 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c48e expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1785390325.366910:0:16426:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1785390325.366926:0:16426:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1785390325.367367:0:16426:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1785390325.369447:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee308 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.369483:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.369500:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee308 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.369933:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717000/0x33dffe75ff5ee301 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c48e expref: 27 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.370026:0:16426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee308 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c48e expref: 26 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.370037:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:0.0:1785390325.370040:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1785390325.370044:0:16426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716000, rc 0) 00000100:00100000:0.0:1785390325.370239:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+26:14523:x1872116847870336:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 10587us (11397us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1785390325.370251:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 50 00000100:00100000:2.0:1785390325.391747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.396410:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847870592 00000100:00100000:1.0:1785390325.396429:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847870592 00010000:00010000:3.0:1785390325.398245:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1785390325.401105:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:2.0:1785390325.401124:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53a892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+26:14523:x1872116847870592:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785390325.401743:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390325.402098:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee308 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c48e expref: 26 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.402126:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50896c600) 00010000:00010000:2.0:1785390325.402140:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390325.402373:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.402390:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.402401:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.402418:0:14295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.402445:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.402453:0:14295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403343:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403354:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403361:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403368:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121de00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390325.403373:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403382:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403393:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390325.403395:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390325.403400:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403407:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121de00/0x33dffe75ff5ee316 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403417:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403429:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403436:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403441:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d200 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390325.403444:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403451:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403460:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x387fbf0e (ffff8cf523a34e00) 00010000:00010000:2.0:1785390325.403462:0:14295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390325.403465:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.403604:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d200/0x33dffe75ff5ee31d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x387fbf0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.403748:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53a892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+25:14523:x1872116847870592:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 2626us (12281us total) trans 0 rc -2/-2 00000100:00100000:2.0:1785390325.403765:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 51 00000100:00100000:3.0:1785390325.409508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.409768:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847870720 00000100:00100000:1.0:1785390325.409780:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847870720 00000100:00100000:1.0:1785390325.409854:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:1.0:1785390325.409867:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+25:14523:x1872116847870720:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.409895:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390325.409923:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee324 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c495 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.409965:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee32b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.410004:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee32b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.410018:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee32b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.410143:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee324 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c495 expref: 27 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.410169:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5a00/0x33dffe75ff5ee32b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c495 expref: 26 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.410180:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:1.0:1785390325.410182:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1785390325.410187:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5a00, rc 0) 00000100:00100000:1.0:1785390325.410259:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+26:14523:x1872116847870720:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 395us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.410275:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 52 00000100:00100000:2.0:1785390325.418931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.422352:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847870976 00000100:00100000:1.0:1785390325.422370:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847870976 00000100:00100000:1.0:1785390325.422495:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:1.0:1785390325.422506:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+26:14523:x1872116847870976:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.422631:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.422650:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.422691:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1785390325.424706:0:14296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1785390325.424724:0:14296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 633979199130ns, next at 634979195851ns, rc = 0 00000004:00010000:1.0:1785390325.425994:0:14296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d367f59c reply state 00000000f98ad777 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390325.426013:0:14296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1785390325.426403:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+28:14523:x1872116847870976:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 3892us (7639us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1785390325.426414:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 53 00000100:00100000:2.0:1785390325.442017:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.442800:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847871104 00000100:00100000:1.0:1785390325.442814:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847871104 00000100:00100000:1.0:1785390325.443020:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 54 00000100:00100000:1.0:1785390325.443033:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+28:14523:x1872116847871104:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.443063:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390325.443101:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c49c expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.443192:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 29 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.443348:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 29 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.443376:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:1.0:1785390325.443398:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1785390325.443402:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f4400, rc 0) 00000100:00100000:1.0:1785390325.443484:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+29:14523:x1872116847871104:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 455us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.443493:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 54 00010000:00010000:3.0:1785390325.450713:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.450738:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.450747:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.450755:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f5c00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:3.0:1785390325.450769:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.450786:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.450812:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:3.0:1785390325.450815:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1785390325.450821:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.451009:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee332 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.451643:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.452576:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847871232 00000100:00100000:1.0:1785390325.452589:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847871232 00000100:00100000:1.0:1785390325.452679:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:1.0:1785390325.452691:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2359:x1872116847871232:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1785390325.453239:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390325.454598:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2359:x1872116847871232:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 1902us (2953us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1785390325.454612:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785390325.472301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.472516:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847871488 00000100:00100000:1.0:1785390325.472557:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847871488 00000100:00100000:1.0:1785390325.472631:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:1.0:1785390325.472643:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+28:14523:x1872116847871488:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1785390325.472941:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+29:14523:x1872116847871488:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 300us (654us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1785390325.472950:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 11 00000100:00100000:2.0:1785390325.488003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390325.488151:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847871744 00000100:00100000:3.0:1785390325.488164:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847871744 00000100:00100000:3.0:1785390325.488245:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:3.0:1785390325.488257:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+29:14523:x1872116847871744:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1785390325.488603:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+29:14523:x1872116847871744:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 348us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390325.488612:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 55 00000100:00100000:0.0:1785390325.512912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.513015:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847871872 00000100:00100000:1.0:1785390325.513029:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847871872 00000100:00100000:1.0:1785390325.513109:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:1.0:1785390325.513120:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+29:14523:x1872116847871872:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.513159:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390325.513188:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee340 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c4a3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.513453:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee347 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.513471:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.513486:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1785390325.513584:0:14297:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1785390325.513610:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee347 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.513642:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4a00/0x33dffe75ff5ee340 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4a3 expref: 31 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.513674:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee347 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4a3 expref: 30 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.513684:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:1.0:1785390325.513687:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1785390325.513690:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5c00, rc 0) 00000100:00100000:1.0:1785390325.513753:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+30:14523:x1872116847871872:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 635us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.513769:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 56 00000100:00100000:2.0:1785390325.523715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.523894:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847872000 00000100:00100000:0.0:1785390325.523907:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847872000 00000100:00100000:0.0:1785390325.523976:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:0.0:1785390325.523988:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+6:2359:x1872116847872000:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1785390325.524012:0:14933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1785390325.524037:0:14933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c4aa expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1785390325.524080:0:14933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a6ae4f5, blocks: 0x1 00010000:00010000:0.0:1785390325.524106:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=634s v=(0 0) 00010000:00010000:0.0:1785390325.524111:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390325.524123:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 7 pid: 14933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.524146:0:14933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 7 pid: 14933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.524163:0:14933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf503716800, rc 0) 00000100:00100000:0.0:1785390325.524252:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:2359:x1872116847872000:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 266us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390325.524624:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1785390325.556734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390325.556946:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847872256 00000100:00100000:3.0:1785390325.556960:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847872256 00000100:00100000:3.0:1785390325.557087:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:3.0:1785390325.557100:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+30:14523:x1872116847872256:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1785390325.557253:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+30:14523:x1872116847872256:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 156us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390325.557270:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 57 00000100:00100000:1.0:1785390325.580217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390325.580411:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847872384 00000100:00100000:3.0:1785390325.580424:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847872384 00000100:00100000:3.0:1785390325.580495:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:3.0:1785390325.580506:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+30:14523:x1872116847872384:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1785390325.809558:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:1.0:1785390325.809600:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1785390325.809631:0:5824:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1785390325.809830:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879323392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1785390325.809916:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390325.810006:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879323392 00000100:00100000:1.0:1785390325.810015:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879323392 00000100:00100000:1.0:1785390325.810078:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1785390325.810088:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879323392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1785390325.812413:0:14931:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1785390325.812423:0:14931:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1785390325.812426:0:14931:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1785390325.812428:0:14931:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1785390325 -> 1785390325 00002000:00010000:1.0:1785390325.812432:0:14931:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1785390325.812548:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1872116879323392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2457us (2628us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1785390325.812560:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1785390325.812642:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf5182fb480/2, rc 0, transno 8589934595 00000100:00100000:1.0:1785390325.812648:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879323392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1785390325.813012:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14523:x1872116847872384:12345-192.168.202.54@tcp:44:lhsmtool_posix.0 Request processed in 232504us (232814us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390325.813023:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 58 00000100:00100000:2.0:1785390325.822977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.823372:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847872512 00000100:00100000:0.0:1785390325.823386:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847872512 00000100:00100000:0.0:1785390325.823500:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:0.0:1785390325.823513:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:2359:x1872116847872512:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1785390325.823704:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:2359:x1872116847872512:12345-192.168.202.54@tcp:16:lhsmtool_posix.0 Request processed in 194us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390325.823712:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 17 00000100:00100000:1.0:1785390325.830669:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390325.830762:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847872768 00000100:00100000:2.0:1785390325.830783:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847872768 00000100:00100000:2.0:1785390325.830849:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1785390325.830861:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14523:x1872116847872768:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1785390325.830928:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390325.830961:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5c00/0x33dffe75ff5ee347 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4a3 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.830989:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:2.0:1785390325.830994:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1785390325.831032:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.831049:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.831060:0:14296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390325.831416:0:14296:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db1ba000 reply state 000000005e717a79 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.831428:0:14296:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1785390325.831618:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+14:14523:x1872116847872768:12345-192.168.202.54@tcp:36:lhsmtool_posix.0 Request processed in 757us (960us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1785390325.831627:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 59 00000100:00100000:2.0:1785390325.840114:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00010000:00010000:0.0:1785390325.840206:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.840221:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.840229:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.840237:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121c800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390325.840243:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.840252:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.840282:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:0.0:1785390325.840285:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390325.840291:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.840298:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121c800/0x33dffe75ff5ee355 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14296 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390325.840863:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847872896 00000100:00100000:1.0:1785390325.840874:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847872896 00000100:00100000:1.0:1785390325.840946:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:1.0:1785390325.840958:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:14523:x1872116847872896:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.840983:0:14933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1785390325.841007:0:14933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c4b1 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.841047:0:14933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.841087:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390325.841093:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390325.841099:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 8 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.841143:0:14933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.841160:0:14933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390325.841177:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14933:1872116879323520:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390325.841297:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf520279f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390325.852711:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.853050:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14933:1872116879323520:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390325.853127:0:14933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 8 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.853159:0:14933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf5421f5c00, rc 0) 00000100:00100000:1.0:1785390325.853238:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:14523:x1872116847872896:12345-192.168.202.54@tcp:101:lhsmtool_posix.0 Request processed in 12282us (13136us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.853250:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 18 00000100:00100000:0.0:1785390325.853462:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873024 00000100:00100000:0.0:1785390325.853472:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873024 00010000:00010000:0.0:1785390325.853516:0:14282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390325.853600:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:0.0:1785390325.853611:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2360:x1872116847873024:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1785390325.853629:0:14282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1785390325.853656:0:14282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.853670:0:14282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.853698:0:14282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002123424c/0x33dffe75ff5ee34e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4aa expref: 8 pid: 14933 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.853717:0:14282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390325.853722:0:14282:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1785390325.853731:0:14282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 7 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.853744:0:14282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 7 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.853794:0:14282:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 7 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390325.853821:0:14282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14282:1872116879323648:192.168.202.54@tcp:105: 00000100:00100000:0.0:1785390325.853881:0:14282:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390325.861459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.861612:0:14282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14282:1872116879323648:192.168.202.54@tcp:105: 00010000:00010000:0.0:1785390325.861643:0:14282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1785390325.861708:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:2360:x1872116847873024:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 8097us (9010us total) trans 0 rc 0/0 00000100:00100000:0.0:1785390325.861720:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785390325.862566:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873152 00000100:00100000:2.0:1785390325.862576:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873152 00000100:00100000:2.0:1785390325.862636:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:2.0:1785390325.862646:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:2359:x1872116847873152:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1785390325.863061:0:14934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1785390325.863075:0:14934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1785390324 00002000:00010000:2.0:1785390325.863078:0:14934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1785390322 00002000:00010000:2.0:1785390325.863081:0:14934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1785390325 -> 1785390324 00002000:00010000:2.0:1785390325.863084:0:14934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1785390325.863127:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2359:x1872116847873152:12345-192.168.202.54@tcp:2:lhsmtool_posix.0 Request processed in 482us (1683us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1785390325.863134:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 19 00000100:00100000:3.0:1785390325.867056:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.867153:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873280 00000100:00100000:1.0:1785390325.867166:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873280 00000100:00100000:1.0:1785390325.867242:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:1.0:1785390325.867253:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf536aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2357:x1872116847873280:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1785390325.867312:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.867336:0:14933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 8 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.867347:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1785390325.867352:0:14933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1785390325.867356:0:14933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.867397:0:14933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 8 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.867414:0:14933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 8 pid: 14933 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390325.867433:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14933:1872116879323776:192.168.202.54@tcp:104: 00000100:00100000:1.0:1785390325.867561:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf520279f00 going to sleep for 11 seconds 00000100:00100000:3.0:1785390325.876279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390325.876383:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873408 00000100:00100000:2.0:1785390325.876395:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873408 00010000:00010000:2.0:1785390325.876447:0:14280:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 9 pid: 14933 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.876504:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1785390325.876515:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+9:2360:x1872116847873408:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1785390325.876580:0:14280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1785390325.876612:0:14280:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 9 pid: 14933 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.876653:0:14280:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 9 pid: 14933 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.876687:0:14280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390325.876693:0:14280:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1785390325.876701:0:14280:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.876713:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.876737:0:14280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1785390325.877010:0:14933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042599083/0x33dffe75ff5ee35c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b1 expref: 9 pid: 14933 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390325.877029:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf5182fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14933:1872116879323776:192.168.202.54@tcp:104: 00010000:00010000:1.0:1785390325.877063:0:14933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877085:0:14933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877093:0:14933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877120:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877129:0:14933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877138:0:14933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877147:0:14933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf5421f4a00 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390325.877152:0:14933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877162:0:14933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877176:0:14933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.877190:0:14933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000494d99c2/0x33dffe75ff5ee363 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.877259:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2360:x1872116847873408:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 745us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390325.877268:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:1.0:1785390325.882508:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf536aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:2357:x1872116847873280:12345-192.168.202.54@tcp:1:lhsmtool_posix.0 Request processed in 15240us (15446us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.882540:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 20 00000100:00100000:2.0:1785390325.890618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.896600:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873664 00000100:00100000:0.0:1785390325.896621:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873664 00000100:00100000:0.0:1785390325.896705:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 60 00000100:00100000:0.0:1785390325.896718:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+13:14523:x1872116847873664:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1785390325.896836:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.896857:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.896871:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.897191:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.897204:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.897226:0:16426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.897281:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.897298:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 14 pid: 14297 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390325.897316:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879323904:192.168.202.54@tcp:104: 00000100:00100000:0.0:1785390325.897416:0:16426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50f00 going to sleep for 11 seconds 00000100:00100000:0.0:1785390325.904011:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879323904:192.168.202.54@tcp:104: 00010000:00010000:0.0:1785390325.904050:0:16426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.906222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:1.0:1785390325.906511:0:14281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873792 00000100:00100000:1.0:1785390325.906540:0:14281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873792 00010000:00010000:1.0:1785390325.906590:0:14281:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 15 pid: 14297 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1785390325.906637:0:14281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:1.0:1785390325.906647:0:14281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+15:2360:x1872116847873792:12345-192.168.202.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1785390325.906665:0:14281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1785390325.906672:0:14281:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 15 pid: 14297 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.906687:0:14281:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 15 pid: 14297 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.906716:0:14281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f4400/0x33dffe75ff5ee339 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c49c expref: 15 pid: 14297 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.906737:0:14281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:1.0:1785390325.906743:0:14281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.906772:0:14281:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.906780:0:14281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.906815:0:14281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1785390325.906947:0:16426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.906966:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1785390325.907215:0:16426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1785390325.907386:0:16426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1785390325.907434:0:16426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1785390325.907574:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16426:1872116879324032:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785390325.907710:0:16426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390325.907748:0:16426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf5118c7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1785390325.907980:0:14281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:2360:x1872116847873792:12345-192.168.202.54@tcp:103:ldlm_bl.0 Request processed in 1332us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390325.907989:0:14281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 16 00000100:00100000:2.0:1785390325.908346:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324032 00000100:00100000:2.0:1785390325.908351:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324032 00000100:00100000:2.0:1785390325.908385:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1785390325.908392:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16426:x1872116879324032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1785390325.908484:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16426:x1872116879324032:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390325.908491:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1785390325.908583:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16426:1872116879324032:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1785390325.909289:0:16426:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1785390325.909355:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16426:1872116879324160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1785390325.909399:0:16426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1785390325.909425:0:16426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1785390325.909627:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324160 00000100:00100000:3.0:1785390325.909632:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324160 00000100:00100000:3.0:1785390325.909663:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1785390325.909670:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16426:x1872116879324160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1785390325.909818:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16426:x1872116879324160:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (417us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1785390325.909825:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1785390325.909991:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16426:1872116879324160:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1785390325.910024:0:16426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910035:0:16426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910050:0:16426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910058:0:16426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390325.910063:0:16426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910083:0:16426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910099:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:0.0:1785390325.910103:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785390325.910108:0:16426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910115:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716000/0x33dffe75ff5ee371 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910151:0:16426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910158:0:16426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910164:0:16426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910170:0:16426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390325.910172:0:16426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910189:0:16426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910198:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:0.0:1785390325.910201:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1785390325.910207:0:16426:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910220:0:16426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910229:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.910293:0:16426:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf5421f5400/0x33dffe75ff5ee2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c480 expref: 17 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1785390325.910305:0:16426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879324288:192.168.202.54@tcp:105: 00000100:00100000:0.0:1785390325.910401:0:16426:0:(client.c:2702:ptlrpc_set_wait()) set ffff8cf50de50300 going to sleep for 11 seconds 00000100:00100000:0.0:1785390325.921384:0:16426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535fbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16426:1872116879324288:192.168.202.54@tcp:105: 00010000:00010000:0.0:1785390325.921427:0:16426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921440:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee2c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921485:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921575:0:16426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921591:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921605:0:16426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921612:0:16426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921619:0:16426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921625:0:16426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503717600 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390325.921630:0:16426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921638:0:16426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921650:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:0.0:1785390325.921653:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1785390325.921657:0:16426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921663:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503717600/0x33dffe75ff5ee378 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921675:0:16426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921687:0:16426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921694:0:16426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921699:0:16426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf503716800 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:0.0:1785390325.921702:0:16426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921709:0:16426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921718:0:16426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:0.0:1785390325.921720:0:16426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1785390325.921723:0:16426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1785390325.921729:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf503716800/0x33dffe75ff5ee36a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390325.929387:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:14523:x1872116847873664:12345-192.168.202.54@tcp:57:lhsmtool_posix.0 Request processed in 32654us (38767us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1785390325.929426:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 60 00000020:00080000:2.0:1785390325.929437:0:16426:0:(tgt_main.c:787:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1785390325.931780:0:14329:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1785390325.931790:0:14329:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1785390325.931850:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1785390325.931857:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1785390325.932023:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390325.932061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390325.932128:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847873920 00000100:00100000:3.0:1785390325.932140:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847873920 00000100:00100000:3.0:1785390325.932182:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847874176 00000100:00100000:3.0:1785390325.932186:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847874176 00000100:00100000:3.0:1785390325.932203:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1785390325.932212:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:14522:x1872116847873920:12345-192.168.202.54@tcp:49:bash.0 00000100:00100000:3.0:1785390325.932412:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+18:14522:x1872116847873920:12345-192.168.202.54@tcp:49:bash.0 Request processed in 200us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390325.932420:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 12 00000100:00100000:3.0:1785390325.932438:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 13 00000100:00100000:3.0:1785390325.932444:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+17:14523:x1872116847874176:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1785390325.933161:0:14299:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1785390325.936331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390325.936445:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847874304 00000100:00100000:3.0:1785390325.936455:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847874304 00000100:00100000:3.0:1785390325.936518:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 21 00000100:00100000:3.0:1785390325.936547:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+7:14522:x1872116847874304:12345-192.168.202.54@tcp:101:bash.0 00010000:00010000:3.0:1785390325.936568:0:14934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1785390325.936593:0:14934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5ee37f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c4b8 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1785390325.936627:0:14934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a6ae4f4, atime: 0x6a6ae4f2, ctime: 0x6a6ae4f4, blocks: 0x1 00010000:00010000:3.0:1785390325.936651:0:14934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=634s v=(0 0) 00010000:00010000:3.0:1785390325.936656:0:14934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1785390325.936666:0:14934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5ee37f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b8 expref: 8 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.936684:0:14934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d521be06/0x33dffe75ff5ee37f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4b8 expref: 8 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1785390325.936700:0:14934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf535ef5e00, rc 0) 00000100:00100000:3.0:1785390325.936758:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:14522:x1872116847874304:12345-192.168.202.54@tcp:101:bash.0 Request processed in 214us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390325.936766:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 21 00000001:00080000:2.0:1785390325.938469:0:14299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1785390325.938619:0:14299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.938637:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.938649:0:14299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.938659:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.938667:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.938673:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390325.938739:0:14299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1785390325.938841:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14523:x1872116847874176:12345-192.168.202.54@tcp:35:lhsmtool_posix.0 Request processed in 6392us (6774us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1785390325.938850:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 13 00000020:00080000:2.0:1785390325.938855:0:14299:0:(tgt_main.c:787:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1785390325.942617:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390325.942702:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847874560 00000100:00100000:2.0:1785390325.942714:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847874560 00000100:00100000:2.0:1785390325.942781:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 14 00000100:00100000:2.0:1785390325.942792:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+19:14522:x1872116847874560:12345-192.168.202.54@tcp:35:bash.0 00000001:00080000:2.0:1785390325.943124:0:14298:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1785390325.943248:0:14298:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1785390325.943371:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:14522:x1872116847874560:12345-192.168.202.54@tcp:35:bash.0 Request processed in 580us (765us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1785390325.943380:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 14 00000020:00080000:2.0:1785390325.943385:0:14298:0:(tgt_main.c:787:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1785390325.943962:0:14284:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1785390325.943974:0:14284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.943986:0:14284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1599300) 00010000:00010000:1.0:1785390325.943991:0:14284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.944003:0:14284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.944023:0:14284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf50692a300) 00010000:00010000:1.0:1785390325.944027:0:14284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1785390325.944033:0:14284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.944041:0:14284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee386 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1785390325.944056:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390325.944077:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1785390325.944079:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390326.105442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390326.105669:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847874816 00000100:00100000:2.0:1785390326.105681:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847874816 00000100:00100000:2.0:1785390326.105751:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:2.0:1785390326.105762:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+22:14533:x1872116847874816:12345-192.168.202.54@tcp:101:lfs.0 00010000:00010000:2.0:1785390326.105801:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1785390326.105834:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee38d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1afc167daed1c4bf expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1785390326.106168:0:14296:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1785390326.106368:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee38d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4bf expref: 24 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.106386:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf523a34200) 00010000:00010000:2.0:1785390326.106390:0:14296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1785390326.106395:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee38d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.54@tcp remote: 0x1afc167daed1c4bf expref: 24 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.106421:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf50121da00, rc 0) 00000100:00100000:2.0:1785390326.107610:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14533:x1872116847874816:12345-192.168.202.54@tcp:101:lfs.0 Request processed in 1845us (2183us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1785390326.107620:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 61 00000100:00100000:0.0:1785390326.113249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390326.113435:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847874944 00000100:00100000:2.0:1785390326.113446:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847874944 00000100:00100000:2.0:1785390326.113516:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:2.0:1785390326.113549:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14533:x1872116847874944:12345-192.168.202.54@tcp:34:lfs.0 00010000:00010000:2.0:1785390326.113664:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.113685:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.113700:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.113720:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.113727:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.113735:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114118:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114128:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114134:0:14297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1785390326.114189:0:14297:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114216:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114224:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114232:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114238:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121da00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390326.114242:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114250:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114269:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf523a34700) 00010000:00010000:2.0:1785390326.114272:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390326.114278:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114284:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121da00/0x33dffe75ff5ee39b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114296:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114301:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114312:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114318:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121d000 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390326.114321:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114327:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114334:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cf523a34e00) 00010000:00010000:2.0:1785390326.114337:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390326.114339:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114345:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121d000/0x33dffe75ff5ee3a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114359:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114365:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114371:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114375:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf50121dc00 already unused, calling callback (ffffffffc1fe14f0) 00010000:00010000:2.0:1785390326.114378:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114392:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114400:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf523a34300) 00010000:00010000:2.0:1785390326.114402:0:14297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1785390326.114405:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1785390326.114410:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf50121dc00/0x33dffe75ff5ee3a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14297 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1785390326.114494:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14533:x1872116847874944:12345-192.168.202.54@tcp:34:lfs.0 Request processed in 968us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1785390326.114503:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 62 00000100:00100000:0.0:1785390326.147470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390326.147670:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875200 00000100:00100000:2.0:1785390326.147682:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875200 00000100:00100000:2.0:1785390326.147748:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 15 00000100:00100000:2.0:1785390326.147759:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+23:14533:x1872116847875200:12345-192.168.202.54@tcp:35:lfs.0 00000100:00100000:2.0:1785390326.148319:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:14533:x1872116847875200:12345-192.168.202.54@tcp:35:lfs.0 Request processed in 560us (863us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1785390326.148328:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 15 00010000:00010000:3.0:1785390326.423517:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1785390326.710362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390326.710417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390326.710472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390326.710561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390326.710877:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875456 00000100:00100000:3.0:1785390326.710891:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875456 00000100:00100000:2.0:1785390326.710900:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875840 00000100:00100000:2.0:1785390326.710904:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875840 00000100:00100000:3.0:1785390326.710971:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1785390326.710989:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:2358:x1872116847875456:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390326.711097:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+24:2358:x1872116847875456:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 110us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390326.711105:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 37 00000100:00100000:3.0:1785390326.711125:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00100000:3.0:1785390326.711131:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2357:x1872116847875840:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:3.0:1785390326.711158:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+6:2357:x1872116847875840:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390326.711165:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 38 00000100:00080000:0.0:1785390326.711215:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1785390326.712516:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875328 00000100:00100000:1.0:1785390326.712545:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875328 00000100:00100000:1.0:1785390326.712601:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1785390326.712609:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf540fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2358:x1872116847875328:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390326.712670:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf540fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b535d1a6-eb8a-4566-b7f2-17b4078f4969+13:2358:x1872116847875328:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 61us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390326.712678:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 127 00000100:00100000:1.0:1785390326.712727:0:14933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875712 00000100:00100000:1.0:1785390326.712731:0:14933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875712 00000100:00100000:1.0:1785390326.712759:0:14933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:1.0:1785390326.712777:0:14933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2357:x1872116847875712:12345-192.168.202.54@tcp:400:kworker.0 00000100:00100000:1.0:1785390326.712805:0:14933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2357:x1872116847875712:12345-192.168.202.54@tcp:400:kworker.0 Request processed in 40us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390326.712812:0:14933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 26 00000100:00100000:2.0:1785390326.730928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390326.731014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390326.731032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:2.0:1785390326.731089:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875584 00000100:00100000:3.0:1785390326.731366:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847875968 00000100:00100000:3.0:1785390326.731371:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875968 00000100:00100000:3.0:1785390326.731437:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847876096 00000100:00100000:3.0:1785390326.731440:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847876096 00000100:00100000:3.0:1785390326.731462:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1785390326.731474:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2356:x1872116847875968:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:3.0:1785390326.731515:0:14931:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ee06f 00000100:00080000:3.0:1785390326.731552:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf4027e5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785390326.731605:0:14931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1785390326.731753:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390326.732450:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+2:2356:x1872116847875968:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 975us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390326.732460:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 22 00000100:00100000:3.0:1785390326.732482:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:3.0:1785390326.732489:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+5:2356:x1872116847876096:12345-192.168.202.54@tcp:9:kworker.0 00000100:00100000:2.0:1785390326.732499:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847875584 00000020:00000080:3.0:1785390326.732504:0:14931:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ee076 00000100:00080000:3.0:1785390326.732512:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf4027e3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1785390326.732550:0:14931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:3.0:1785390326.732668:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a56b208-1f4e-4386-b3a5-8a55bf5a472f+2:2356:x1872116847876096:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 179us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390326.732675:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 23 00000100:00100000:3.0:1785390326.732689:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 24 00000100:00100000:3.0:1785390326.732695:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+5:2356:x1872116847875584:12345-192.168.202.54@tcp:9:kworker.0 00000020:00000080:3.0:1785390326.732709:0:14931:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x33dffe75ff5ee037 00000100:00080000:3.0:1785390326.732717:0:14931:0:(import.c:65:import_set_state_nolock()) ffff8cf535a51000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1785390326.732937:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1785390326.732943:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1785390326.734681:0:14931:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1785390326.735147:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf50de83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+2:2356:x1872116847875584:12345-192.168.202.54@tcp:9:kworker.0 Request processed in 2443us (4226us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390326.735158:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 24 00010000:00010000:1.0:1785390326.740228:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1785390326.746305:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390327.321358:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879324416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1785390327.328751:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390327.328886:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324416 00000100:00100000:3.0:1785390327.328898:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324416 00000100:00100000:3.0:1785390327.328963:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1785390327.328974:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879324416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1785390327.329027:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1785390327.329092:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1872116879324416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390327.329109:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1785390327.329134:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1785390327.329178:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1872116879324416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1785390327.447998:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1785390327.531935:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf 00000020:00000080:2.0:1785390327.531948:0:6622:0:(genops.c:906:class_export_put()) final put ffff8cf535a52000/046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf 00000001:00100000:2.0:1785390327.531979:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00000020:00000080:2.0:1785390327.531982:0:6622:0:(genops.c:906:class_export_put()) final put ffff8cf4027e1000/1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00000020:00000080:3.0:1785390327.535497:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf535a52000/046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf for lustre-OST0000 00000020:00000080:3.0:1785390327.535634:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf4027e1000/1a56b208-1f4e-4386-b3a5-8a55bf5a472f for lustre-OST0000 00000020:00000080:3.0:1785390327.535688:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf535a51000 for lustre-OST0000 00000020:00000080:3.0:1785390327.535693:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf4027e5000 for lustre-OST0000 00010000:00010000:2.0:1785390328.470557:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390328.756048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:3.0:1785390328.756098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.54@tcp (source: 12345-192.168.202.54@tcp) 00000100:00100000:0.0:1785390328.756255:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847876224 00000100:00100000:0.0:1785390328.756269:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847876224 00002000:00100000:0.0:1785390328.756343:0:14937:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8cf53fc01880 x1872116847876224/t0(0) o4->046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf@192.168.202.54@tcp:314/0 lens 504/0 e 0 to 0 dl 1785390339 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1785390328.756356:0:14937:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fc01880 with x1872116847876224 ext(0->8) 00002000:00010000:0.0:1785390328.756364:0:14937:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53fc01880 00000100:00100000:0.0:1785390328.756398:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 0 00000100:00100000:0.0:1785390328.756409:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+8:2358:x1872116847876224:12345-192.168.202.54@tcp:4:bash.0 00000100:00080000:3.0:1785390328.756411:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1785390328.756989:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+10:2358:x1872116847876224:12345-192.168.202.54@tcp:4:bash.0 Request processed in 580us (964us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1785390328.756998:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 0 00002000:00100000:0.0:1785390328.757005:0:14937:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8cf53fc01880 x1872116847876224/t8589934598(0) o4->046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf@192.168.202.54@tcp:314/0 lens 504/448 e 0 to 0 dl 1785390339 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1785390328.757014:0:14937:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf53fc01880 with x1872116847876224 ext(0->8) 00002000:00010000:0.0:1785390328.757017:0:14937:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cf53fc01880 00000100:00100000:1.0:1785390328.757156:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116847876352 00000100:00100000:1.0:1785390328.757161:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116847876352 00000100:00100000:1.0:1785390328.757203:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.54@tcp, seq: 25 00000100:00100000:1.0:1785390328.757211:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+10:2358:x1872116847876352:12345-192.168.202.54@tcp:16:kworker.0 00000001:02000400:0.0:1785390328.838353:0:16467:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1785390328.926166:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:046e088f-c3ab-40b0-abcb-c4ecf4d5f2cf+10:2358:x1872116847876352:12345-192.168.202.54@tcp:16:kworker.0 Request processed in 168942us (170054us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390328.926197:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.54@tcp, seq: 25 00000001:00080000:1.0:1785390328.926255:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1785390328.926274:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00100000:1.0:1785390328.926288:0:7506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00000020:00000080:1.0:1785390328.926292:0:7506:0:(genops.c:906:class_export_put()) final put ffff8cf4027e3800/1a56b208-1f4e-4386-b3a5-8a55bf5a472f 00000001:00080000:1.0:1785390328.926318:0:7506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000020:00000080:3.0:1785390328.928160:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8cf4027e3800/1a56b208-1f4e-4386-b3a5-8a55bf5a472f for lustre-OST0001 00000020:00000080:3.0:1785390328.928231:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cf4027e3000 for lustre-OST0001 00010000:00010000:1.0:1785390329.494296:0:14283:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1785390329.878298:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879324928:0@lo:400:kworker.0 00000100:00100000:3.0:1785390329.878516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390329.878659:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879324544:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.878705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390329.878872:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879325056:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.878902:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390329.878932:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1785390329.878938:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879324672:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.878966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390329.878988:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879325184:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.879010:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1785390329.879057:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324544 00000100:00100000:1.0:1785390329.879066:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324544 00000100:00100000:1.0:1785390329.879978:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1785390329.879993:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf522cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.880074:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf522cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:374ce4d4-733e-4fe2-9421-711e41cbfd01+19:3309:x1872116879324544:12345-0@lo:400:kworker.0 Request processed in 84us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390329.880082:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1785390329.880124:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324928 00000100:00100000:1.0:1785390329.880130:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324928 00000100:00100000:1.0:1785390329.880176:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879325056 00000100:00100000:1.0:1785390329.880179:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879325056 00000100:00100000:1.0:1785390329.880205:0:16426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879325184 00000100:00100000:1.0:1785390329.880208:0:16426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879325184 00000100:00100000:1.0:1785390329.882253:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785390329.882273:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf53fc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879324928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882351:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf53fc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1872116879324928:12345-0@lo:400:kworker.0 Request processed in 88us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390329.882359:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1785390329.882385:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785390329.882392:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882420:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1872116879325056:12345-0@lo:400:kworker.0 Request processed in 30us (3517us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390329.882427:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1785390329.882437:0:16426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785390329.882444:0:16426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879325184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882481:0:16426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1872116879325184:12345-0@lo:400:kworker.0 Request processed in 38us (3470us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390329.882487:0:16426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1785390329.882515:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324672 00000100:00100000:1.0:1785390329.882537:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324672 00000100:00100000:1.0:1785390329.882583:0:14931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785390329.882589:0:14931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf5182fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879324672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882620:0:14931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf5182fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1872116879324672:12345-0@lo:400:kworker.0 Request processed in 32us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390329.882626:0:14931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1785390329.882678:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1872116879324672:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882706:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1872116879325184:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882717:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:374ce4d4-733e-4fe2-9421-711e41cbfd01:3309:1872116879324544:0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.882727:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1872116879325056:0@lo:400:kworker.0 00000100:00100000:0.0:1785390329.883817:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf535da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879324800:0@lo:400:kworker.0 00000100:00100000:0.0:1785390329.883878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1785390329.883942:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1785390329.883947:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1785390329.884099:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1872116879324928:0@lo:400:kworker.0 00000100:00100000:0.0:1785390329.885296:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8cf53fc03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879325312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1785390329.885336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1785390329.885421:0:14935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879325312 00000100:00100000:3.0:1785390329.885429:0:14935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879325312 00000100:00100000:3.0:1785390329.885485:0:14935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785390329.885493:0:14935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879325312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1785390329.885517:0:14935:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1785390329.885577:0:14935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879325312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1785390329.885585:0:14935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1785390329.885617:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1785390329.885634:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf5182fb480, transno 8589934595 00000004:00080000:3.0:1785390329.885647:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1785390329.885679:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf53fc03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879325312:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1785390329.886306:0:14291:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1785390329.886411:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872116879324800 00000100:00100000:1.0:1785390329.886417:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872116879324800 00000100:00100000:1.0:1785390329.886456:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1785390329.886471:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf535da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879324800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1785390329.886518:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf535da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1872116879324800:12345-0@lo:400:kworker.0 Request processed in 48us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1785390329.886548:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1785390329.894502:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8cf535da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1872116879324800:0@lo:400:kworker.0 00010000:00010000:2.0:1785390330.522242:0:14284:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1785390330.964296:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00080000:1.0:1785390330.964316:0:5824:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf50de503c0 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1785390330.964322:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf5182fd700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf50de50f00 00000020:00080000:1.0:1785390330.964326:0:5824:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8cf5182fd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf510758000 00000001:00080000:1.0:1785390330.964353:0:5824:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:2.0:1785390330.964490:0:14333:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:2.0:1785390330.964748:0:14333:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 Debug log: 31742 lines, 31742 kept, 0 dropped, 0 bad.